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^ Abstract 

the report summarizes the data from a-comparative study of Grades 2 and 
reading instruction and the use of the Wisconsin Design for Reading Skill 
Development (WDRSD) in IGE and non-IGE settings. These results are part 
of a five-phase eva^^uatio^ of the IGE system of elementary schoolljig. Ude 
t)f the Wl^RSD and reported adoption of IGE^were not found to be g^od indica- 
tors^ of^nstructional patterns in^ reading skills. At Grade 2, tli^ ilistruc- 
'tional emphasis was on word attack skillg^; at Grade, 5 , ^ there^was /no pattern 
across '.schools , Although a lower limit on allocated time is nreeded to in- 
crease achievement on any objective, the relationship between allocated time 
and achievement is not linear. 
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Introduction to the Study 



T-his paper rqports the results from one of two coTnparat(ive stud'ies ^ 
which wijre a part of Phase IV^of the Individually Guided Education (IGE) . 
Evaluatiot/ Project. />phase IV was^one.of five related phases comprising 
an extensive evaluation o'^f^IGE. This report summarazes the data from^ 
comparative study of reading instruction.- and/^t he use of -the Wisconsin^ 

Design for Reading*^ Skill Development (WDRSD) in IGE and non-IGE settings. 

' ' ■ ' • I ■ • ^ ■ 

These refjults should be seeni as a part of a larger evaluation of the 

tlCE system of elementary schooli;ngy^^ \ 

An Overview o f th e Evaluation Project ' ^ 

^ " " ■~' ^ , 

Through the obmbiped -efforts of the Wisconsin Research and Development 
Center for^ Individualized Schooling, t^he University of jWisconsin IGE ^ 

Teacher^ Educat/ion .Pro j ect , the Kettering Foundation (I/d/e/A), and IGE . 

/ * \ ^ - ■ • . . \ ' • ' 

coordinators in' 25 states, moire than 2,000 elementary schools have adopted 

9 ' ' ' ' ^ 
a system called Individually Guided Educ.ation. ' . • - 

The purpose -of * the IGE Evaluation' Project^ which befgan in 1976, was 

\ r • ■ ■ 

twofald. First, we intended to evaluate IGE to 'gain a^^^mOref comprehensive 

; . ^. ■ , K • . .. ^ 

view of the system's operation and effectiveness. Second, we hoped to/ 
.identify which features contribute most t® the success of .reading and 
mathematics instruction as a result of a reform/change model, and to use 
. ^ the findings to study larger theoretical issues about instructional vari- 
ables, cuS^iculum planning, school change', and so forth. 



The work ot.' tho^project was separalcd^ into five phases, .Phase I 
Wcis .1.." iar).^e .-jciin p I. e> s L u d y wh'ic ti provided . ba ic inf ormait ion about ICE . ^ 
srhonl iiiK. fc-aturos of TGF/ fjchooling were reputedly crucial - 

U); i;(U«: success, and the purpose of -Phase I wa^ to , examine the extents^ 
\iO which those features had been implemented in TGE schools and to assess 
^Llie effectiveness of that implementation. .Information was obtained from 

V ■ 

tlie^ staff^s of ' approximately 155 IGE schools using self-report surveys 
fand-fnom students usirtg standard paper-and-pencil instrument's.' Jhe" data 
were intended to provide a functional understanding of IGE features, pro- 
eesses,\and outcomes by. relating a broad scope o£ variables in an inter-' 
pri'tativc manner (Price, Romberg, & Janicki , 1981) . ^ . . - 

Hhase II' verified and. extended the self-rel^ort data gathered in 
Phase r to include more fully th'e range of variables that, determine 
the process of schooling (Ironside ^ Conaway, 1979). 

'1* Phase '111 focused on the social meaning which emerges as ICE^ is . 
implemented on a day-to-day basis. The problem of under^standang the . 
Liupact of educational reform can be approached by vieving schools as; 
social, institutions whose cha'rac terist ic s ■ shape and are 'shaped by the ^ 
behaviors of their njembers. This focus allows us to think of a school 

K y ' ' \ . — . 

as ^4 complex soci'al a^rjrang-ement consisting .of underlying Npatterns of ^ y 

• I* . 

conduct which channel thought .aad'' act ion within: that settings (Popkcwi tz , . ^ 
'Tabachnick, &*Wchlage, in press), 

, Phase r.V was designed to examine how effectively the three curricula'r 
programs ( pr eread i ug , rividhin, ^nd mathematics) ilovc»r(a){(r7o r ~I C;+: inrcl. 
their objectives and to Ln>^ti?5?igate the relationship of inf^t rue tional . 
time and means o f'^^'ins true tibn to pupil outcojae^. • ^ . 



Finally,' the g6al of Phase. V is to synthesize the results' of 
Phuses I through IV and to address the significant issues in contem- 
porary schooling raised by the project as a whole. Thus, each phase 
of the evaluation was designed to Qomplement and st-rengthen the 
validity of the data gathered by the previous phases. For example, ^ 
data ""on means of instruction, gathered by the large-sample study of ■ 
Phase 1, weie examined in somewhat greater depth in fewer schools by 
the Phase II studies. Pfxase Ill's analysis developed a view of 
instruction from a different perspective. Phase IV explores means of 
instruction in reading anid mathematics. Phase V was designed to integrate 
and interpret- the data .from all the preceding- phases into a series of 
statements of -the project's ijnplicat ions for educational issues., 

'Individually Guided Education 
IGE is a complex system based on theoretic and pragmatic ideas 
about schooling, children's leatnTtv^, and the professional roles of 
school staffs (Klausme^er, 1977). This system has seven components: 

1. Multiunit organization 

2. Instructional programming for the individual student 

3. Assessment and evaluation for educational decision making 

4. Curricular and instructional materials and activities for 
each child's instructional program 

• 5. Home-school-community relations, program 

6. Facilitative environmepW for professional growth, and 

7. Continuing researchSind development for system .improvement 

i ■ - " : 

I ' ■ . 

■jo I 



To relatr"tHese seven component s a descriptive f ramework was.^ 
. -J - \ ■ »\ 

dcvelopftcUt-hai: considers outcomes of lGE\a^ a function, of both instruc- 

tional Vean^s and the' degree of implementatx5n (Rombr-rii, 1976)._ Four 
types of variables were' identified to guide the evaluation of ^GE: 
pupil and staff outcomes means of instruction, support systeir.s, and . 
Vupil and staff b^kground. Figure 1 shows how the four types oo'^ 
variables were rel'S^tedr * 

• ' . 1 . Pupil- and staff outcomes, and the extent to which these 
outcomes have been attained, should be the initia l basis'of an IGE 

Gvaluatidn. Both pupil and staff out>-.omes are illustrated in Figure 1 

; , / . , 

as <being multivariate and multilevel. .In this study a set of curriculum 

specific pupil achievement scores in reading was used. 

" 2 . The in'strijctional means of formal sch'ooling must be a second 
basis for an evaluation of IGE . It has been fashionable in evaluation 
circl>,es to concentrate on ends or outcomes and to, ignore the means by 
which they are/ reached. Reform movements, such as IGE, invariably 
attack the properties of means. To this extent judging the value of 
the means is as important as assessing outcomes. 

The means of instruction considered in the evaluation project were 
separated into three sets. of activities based upon the operating char- 
acteristics of IGE schools:-^ staff activities of-*the Instructional 
Improvement Committee (IIC) an^ the Instruction and Research Units 
(I-i&J^ Units),, activities of the staff teacher both in curriculum 
"management and pupil interactions, and activities of pupils related to 
reading and mathematics instruction. 
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Figure I. Kair.ework (or an IGE evaluation (Romberg,' 1976) 
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^3. • Both pupil and staff backgrounds'^are shdwn as influencing m eans 
cjf instruction and outcomes . Also, staff background is in turn influenced 
by training fn the support systems. ^For pupil background both initial, 
achievement and demogr-aphic data were collected* 

. 4 . Tii (r~d'(^rofe ar d manner in which support systems of IGE have 



[)cc\\ In corpora ted and developed in a school must be judged . The seven 
comT>bnent:s of IGE have^evci)lved as practical ways of supporting new 
instructional methods , |which in turn produce desired pupil and staff 
outcomes. It can be argued that the efficiency of an IGE school de- 
ponds lipon the components implemented and the manner in which they are 
"operating, , ^ 

The support systems for an IGE learning environment were separated 
"'into four categories as indicated in Figure 1^, The second category, 
curricular materials compatible, with instructional programming and 
ovaluation (ICE Componen^t 4), is shown by ide^ifying the three major 
rurricular pro.diicts developed for ICE, the Wisconsin Desiga for Reading 
Skill Development (WDRSD) (Otto, 1977), Developing Mathematical Processes 
(DMP) (Romberg, 1977), and the Pre-Reading Skills Program (PRS) 
(Venezky h Pittelman, 1977). The functional relationships illustrated 
in Figure I convey the following 'premises: (a) the degree to which 

s 

\GV. support systems have been implemented, together with pupil and 
st'nl'J backgrounds, d irectly inf luc^^ees the means of instruction in 
an school; and (b)'thh means of instruction, along with pupil and 

Starr hackj^rounds, account for pupil and ' staf f^utcomes . " . • ^ 

' Although much has been written nbout the conceptual background 
ol 1(11;', no'comprehen s i vo picture now shows how IGE has been implemented 

17 



Ln elementary schools. Thus, the IGE Evaluation Project was designed 

i5p gain a more comprehens^'ive view of the system's operation and 
* f 

effectiveness. The desired outcome is to identify which features 
contrib,ute most to the g^uccess of reading skills and- mathematical . 
instruction as a result of individualized schooling, 

V. * 

Overview of Phase IV 
\ Tlie intent of Phase IV "was to describe in considerable detail the 

" \ „ . • V " ^ 

actual operating characteristics of a sample of schools which were 
using curriculum materials designed to be compatible with IGE, Phase IV 
was re^tjricted to the investigation of three groups of variables — pupil 
outcom'es,^ instructibnal time, and means of instruction — in IGE and ' ^ 
non-IGE sett^,iTgs in which the Center's curriculum programs as well as 
al LerJ-iat ive curriculum materials were being used, .A^upil, attainment 
of program objectives is the main variable. The other two' variables, 
instructional time and means of instruction, are essential in explaining 
and understanding how the programs work and how objectives, axe attained. 
These two variables are .also important from a practical P^nt of view 
because they can be manipulated- by teachers. Describing the use of 
each program in terms of allocated time, engaged time, and instructional 
activities provides concrete factors that; teachers can work with (Webb & 
Romberg, 1979) , ' ' ■ jr 

In addition, instructional time was Included because of recent 
studies and reviews that stress its importance and its relationship to 

pupil outcomes (Harn i schf eger & Wiley, 1975; Rosfenshine, 1977 ; McDonald 
* ■ 

& Elias, 1976; Fi^er et al . , 1975)." As^ Harnischfeger and Wiley state, 

■ ^ ■ r . ■ ' 

is: 



• /■ • • 

"All rnriueiices od pupil achievement mustl be mediated through a pupil s 

active and passive pursuit" (1975, p. 15)'. Certainly there is enough 

evidence to suggest t?h^at; instructional time is an important measure ot 

pupil pursuits. Its use as a variable in Phase IV, then, had two 

pi:riJ<^«^^«» KirsL, the amount of time during which students are actively 

en^ag^ul in learning :whbn using one of the three programs is a means' of 

describing how the programs are being used. The a^ssumption is that the 

' , • , ^ ■ 

-progr^ams should maximi-ze student engagement by attending to^the indi- 

vidual's needs. Second, Phase IV provided an excellent opportunityx 

■ ' , ^ V. . . \ 

L() .sLiidy in more detail fhe relationship of- pupil outcomes to mstruc.-^ 
■ t i i:)iuil t ime . 

In .summary, the primary purposes of Phase IV were:- ^ , ' ^• 

1 . ,t() determine the degree to which WDRSD and DMP meet their 
_^ goals of having students master specified objectives and 

skills ^^--^ .■ . ' • ' . 

2. to determine how time ,is allocated for inst;ruction .in 

^ implementing WDRSD and DMP ' j . * 

3. to relate instructional time to the means of instruction 
and mastery of content' for WDRSD and DMP, and r 

A. for each curriculum program ,^ WDRSD and DMP, to- contrast two 
situations — iCr: schools using tiie program with non-TO!' 
schools using the program and CGE schools using' the program 
w.ith ICK schO'.)is using alternative prbgrams— :on the var.iables 
of pupil outcomes, instruct ioQal> time, and means ^of inst^puc- 
t ion ^ \ 

\ ' ' ' / 

Kive studies were conducted as part of\Phase IV, three descriptive 

•Uudii's and two eompa ra L ive s tudies . The descriptive studies wfere 

■ .MKil! ^;a!iiple studies designed to .describe how the curriculum programs 

DMP, WI;RSD, and- PRS were being used in iGE^schools. The studies ^ -re 

\ 

.•(indncted during the .winter and spring of 1978 at twp HCE scho- ^ 
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using DMP (Webb, Nefenztl Romberg, & Stewart, 1980), two IGE schools 
using WDRSD (Nerenz , Webb, Romberg, & Stewart, 1980), and three- IGE 
schools using PRS (Stewart, Nerenz, Webb, & Romberg, 1980): The two 
comparative studies also focused on the use of WDRSD and DMP in IGE 
settings. This rep^fF^is'' on the use of WDRSD'. 

■ ' '\ . • ■ ■ 

Model for Phase IV j ' y 

I . 

A structural model for predicting s tudent , -achievement was developed 

' for PKase I (Price; Janicki, Howard, Stewart, Buchanan, & Romberg, 1978) 

froiA the three premises on which IGE is based. 

/ 1. Certain organizational features make it more likely that 

certain desirable instructional practices will occur. These 
organ izationai features also make it more likely that the 
staff will be satisfied with their jobs. 

2, The use of certain curr iculum materials and associated 
systems of information collection and 'record keeping makes 

it more likely that certain desirable instructional practices 
) will occur. A , ^ 

3, Those instructional practices which are deemed desirable in 
^ IGE make high student achievement more likely. They also' 

\" ' make it more likely that desirable 'changes in other student 
/ characteristics, such as self-perception and locus of contral, 

will occur. 

Phase IV was designed to provide more detail on the last two premises 
posed in Phase I, with specif ic .^attention paid to means of instruction 
\ and curriculum-related student achievememt, while proyiding sufficient 
background information that each school in the smaller Phase IV sample - 
might be related on several significant .dimensions to thfe findings of 
the larger Phase I sample. Thus, some information was collected on 



five of -the six school-wide variables used in. Phase I — General Imp^-ement- 
ation of the Instructional Programming Model (IPM) , Intraorganizaf^^nal 
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SlnicLiire (TOS), Procedures Fostering Coordination and Improvement: of 

the School Program (COS), i^nterorganizat ional Relations tlOR) , and 

General Staff Background ((?SB) . In 'Phase IV the program use vari^^lfes-- 

Cif-rr iculum Implemcntat iorf'^ancj Program' Customizing — included the kind's^ 

Df I lU ormat Ion provided the Phas^ I curriculum-specific variables. 

Moro detailed information about classroom procedures and achievement 

outcomes was also collected in Phase IV. A mo del.n depict ing the Phase IV 

variables and the anticipated relationships is shown in Fi^re 2. 

Four groups df variable^ are shown in Figure 2 — school background, 

currLc ulnm program use, classroom ac'tivitics, and pupil outcomes. As- 

C:t> ... 
:sr./>led above, the sc hqpl' variables , which were assessed through, struc- 

tured interviews with school staff, provide a link between the Phase. IV 
sample and the larger Phase I sample. Curriculum program use variables, 
also measured through structured interviews, have a linking function to 
Phase I and provide a descriptive background for the measures of cLass- 
room procedureg.\ These procedures were assessed- through logs maintained 
by teachers for selected students and through bbservations in the class- 
rooms; means of instruction and the use of instrucu ional Lime are detailed 
measures ol how i)rograms are used^ in class rooms and|frelate directly to 
pupil attainment: oi' objectives. Pupil outcomes were s^pecificd in terms 
• 1)1 stated objectives of W1>RSD and were assessed through achievement- 
monitoring i)rocodu res. * ^ 

The WDRSD Program ^ 

♦ <\ 

\n ordc^r to bettof uiKio'rs tnnd tlie data gntlierinK procP(hir(\s used 
in this study, a brief introduction to the Wisconsin Design for Reading 
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Webb, Stewart, & Nerenz, 1980, p. 



Skill Development: (Wl)RSD) may be helpful. The WDRSD is. an objecCive- 
based system that v/as developed to provide both structure and substance 
tor an elementary school reading program to be compatible with the com- 
ponents of IGE/ yTl^ie focus ^is on developing the essential subskills of 
reading, which once acquired and applied enable students to read success 
t'lilly. It has four fundamental purposes: 

Lo Identify and describe instructional objec Lives for the 
skills which appeal esseuLlal fui' competeiwe in reading 

2. to assess individual pupils'' skill development status 

3. to manage instruction of children with different skill 
. development needs, arid 



U. t.o monitor each pupil ' s progress (Otto & Askov, 1974) 

The WHF'vSD provides a framework for teaching reading skills as the basis 

• ■ - — - * 

of a curriculum in which individual differenceis in students' rate and 

style of. /earning are accommodated. This organization of instruction 

includes five major operations: " ^ 

"1. identification of-^a list of essential reading skills, with 
consensual, historical, and/or ^empirical support 

O 

2. statement of objectives specifying the criterion behaviors 
related to each skill 

3. assessment 'of children to determine who has or has not 
already mastered each skill ' ^ ' 

' ^ , / 

4. identification o^ appropriate materials and activities 
'for instruction in each skill, and finally 

'• S. < 'va-l ua i;.i:c)n of I. t^ariT i ti;; / " " n 

' ' . . ■ / . - ■ . * \ - 

"^iased on these operations, Kje following material components for. 

^ 

.the WDRSD curriculum program were developed: 



24 



13 



1, descriptions of the skills which";appear essential for* competence ^ 
■\ in reading . ' . 

■ * /' 2. assessment instruments for 'determining student^?', skill strengths, 
and weaknesses ^ 

3. management guidelines for skill instruct ion grouping, testing, 

and monitoring 
) ' • ^ ^ 

^1. ' sample instructional^^act ivities to develop the skilly, and 
5. ovaluation guidelines * 

III the skills and ol?jectives component, six skill areas have been 
identified: Word Attack, Study Skills, Comprehension, Self-directed 
Reading, Interpret ive R'ead ing , and Creative Reading, Behavioral objec- 
tives were written for each skill in t^e first three of these six 
areas. Assessment exercises and teacherS^' resource files accompany 
each of these objectives. The skills in the other three areas are , 
not behaviorally described and assessment exercises are not incluaed. 
Skills in each of the six areas are clustered at levels that corres- 
pond to traditional grade levelSj, as >shown in Table 1, in order to 
facilitate initial implementation and to help in general skills 
assessment and regrouping, , ^ 

Formal tects of demonstrated^ reliabil ity 'which , are suitable for 
individual or group administration and which aid. in the preparation 
of skill developmental .profiles have ,been developed for most of the 
skills in Word Attack, Comprehension, and Study Skills, There are 
two available forms, .Form P and Forfn Q* The forms are parallel and , 
may be used interchangeably. 

Each test is keyed to a specific objectiV^^, and^^tests are available 

in two formats: separately for a single skilly or in booklets which 
I* 
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3 ^» 
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• ]> 




(lompre:! tension^ / 
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■ c 


D P. 


. P ^ 


Study Skills k 


A 


'B 


c 


n R 


I' 


. SeLC-directed Heading 




A--C 






F-C 


Tiitcrpret ive Reading 




A-C 




n-E 




Creative Reading 




A-C . 




D-.E 


F-G 



6 



9 



include all the skills at a given level. The tests are criterion ref- 
erenceci and generally machine-scorable. Certain skills which covdd not 
be assessed adequately^ with paper-andT-pencil tests are assessed with in- 
dividually administered performance tests. 
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Design of the IGE/WDRSD Comparative Study 

> 

Details of this study of reading instruction in IGE and non-IGE 
schools are described in this chapter. Included are the research 

questions to be examined; the basic design of the study, including 

' " ^\ ^ 

the sampling procedure used; how the data were collected, sfggregated, 

/ 

and scaled; and the analysis plan. 

Research Questions 

As discussed in Chapter I,- this s tudys^xamined three primary re- 
search questions: « • ^ 

1. What are the effects on reading instruction of using the 
WDRSD reading program in an IGE and a non-lGE school environment? 

To answer this question, data were gathered from a sample of IGE 
schools using the WDRSD and a similar sample of non-IGE schools using 
the same program. 

2. What are the effect's on reading instruction of using WDRSD- 
and using other reading programs in the IGE school environment? 

To answer this question, data from the sample of IGE schools 
using WDRSD used to answer Question 1 and data from a sample of IGE 
schools using other reading programs were gathered. 

3. Wiiat are the relationships between, the variables presented, 
in Figure 2? 
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To answer this question, data from the total sample of schools 
used to examine the first two questions will be used. The diagram 
iji Figure 2 could be considered as a. structural design, path diagram, 
or causal model. Ideally, if each of the variables specified in the 
diagram was scaled, a set gf structural equations corresponding to 
the model could be written; Then these equations could be statistic- 
ally examined for .their agreement with the data collected in the Phase 
IV study. Within the limits imposed by measurement error in the 
procedures used to collect the data, this approach would test the 
theoretical model. Unfortunately, this structural analysis could not 
be carried out. The small number of cases coupXed with difficulty in 
scaling some variables (lea'Sing to several separate variables—in 
particular, a larger set of student achievement variables) and dis-^ 
agreement on the existence (or non-existence) of some relationship^ I 
(paths) made such amanalysis ,unf aasible. ' Instead, a two stage multiple 
regression analysis was carried out. For the first stage, student 
eft'^^ged times on content objectives were used as- the dependent vari^ 
ables and the classroom activities, curriculum, and school variables 
were entered as independent variables. At the second stage, student 
achievement scores were used as the dependent variables and the 
student pursuit ^variables were then added to the^ other variables. 

Operationally, there were three problems associated -with an- 
swering these questions. First, reasonable samples of schools had 
to be recruiced for the study so that appropriate comparisons could be 
made. The sampling plan is described later in this chapter. Second, 
since the schools differed only il 'Mabels'* for their instructional 
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environment (IGE or not) or their reading program* (VJDRSD or not), and 
since we Rnew schools varied in their degree of commitment andmanner 
of use with regard to both IGE and WDRSD, somia data were needed to 
demonstrate that the labels reflected actual ope^-ational differences. 
Third, we needed to aggregate and scale the ^variables associated with 
reading instruction. Details of how this was done follow in this 
chapter . . 

The Basic Design " ^ • 

Data were gathered for this comparative study'^from October until 
May during the 1978-79 school year. As described, three types of ^chools 
wer^ irtcluded in the ^tudy: 

1. IGE schools using WDRSD 

2. Non-IGE' schools using WDRSD ^ 

3. IGE schools not using WDRSD 

Data were collected only from ^students in Grades 2 and 5 and their teacher 

in those schools. Data were collected by four means: tests on general 

, ~ \ ^ ... 

objectives of WDRSD, observations of speciftic students during the reading 

instruction period, teacher logs for reading instruction of specific 

students, and questionnaires which served as the basis for structured 

interviews with school staff. 

Sample . Four WDRSD triads of schools were" idea tif ied to participate 

in this study. Each triad was to have one school of each of the three 

lyix'S. S(^h()<>lf' within o;ir!i triad were m.'i tcljcd .icco r<N n)' In I ocn I f (Hi , 
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socio-economic level, composition of student body, size, and, for the 
TGE schools, "IGE-ness." The same demographic categories used in 
Phase I (Price et al., 1978) were used to classify the communities . 

e 

in which the schools^were located: 

lA Extreme rural—community with a population under 3,bO0 where 
* most of the residents are farmers or farm workers 

2. Small pSLace— community with a population of less than 25,000 

3. Medium cjLty--city with population between 25,000 and 200,000 

4 Main big city--coimnunity within the city limits of a city with 
population o'ver 200,000 and not included in the high or low 



metro groups 



5. High metro— area in city with a population greater than 150,000 
• where a high proportion of the residents are in professional 

or managerial positions 

6. Low metro— area in city with a population .greater than 150,000 
where a high proportion of tHe residents are on welfare or not 

^ regularly employed 

7. Urban fringe community within the irie^opolitan ar.ea of a city 

with a population greater than 200,000 outside the city limits 
and thus not in the high or low metro- groups 

The four triads of schools in the WDRSD study represented extreme rural, 
small place, medium city, and urban fringe. One urban fringe ICE school 
not using WDRSD withdrew from the. study just prior to the beginning of 
the data collection'. Thus, the urban fringe group was reduced to two 
schools, an IGE school and a noh-IGE school both, using WDRSD, bringing 

i 
I 

the number of schools in this study to 11. 
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Data collection . Four procedures were, used to collect data from 
second- and fifth-grade pupils and teachers in the 11 schools. 

Pupil outcomes were measured using an achievement monitoring 
procedure with item sampling. The WDRS^ program contains units of 
instruction skills based "on the IGE instructional programming model, 
.(IPM) . Once a pupil has mastered the objectives, he or she is to be 
regrouped with the other p.upils with similar needs and given instruction 
on a new skill- The instructional sequence' of skills should vary from 
pupil to pupil. Because of this variation in the instructional programs 
which pupils receive, an achievement^monitor ing procedure with tests 
administered at eight points during the school year was chosen to 
provide information on the attainment of objectives. Such a procedure 

is more sensitive to the individualization of the {Drograms than other- 

J 

^ \ ■ 

designs, such as pre- and posttesting. 

Th^ tests used in the IGE descriptive studies (Webb & Romljbet^, 1979) 
were refined for use in the comparative studies. The tepts we^^^Ompiled 
by identifying 2fi WDRSD skills in Grade 2 and 26 WDRSD skills for Grade 5. 
Two to four items for each of the WPRSD skills were then prepared to form 
an itiem pool for each grade level. Items from each pool were distributed 
among four forms using an item sampling* technique*.. All achievement 
monitoring test items were constructed in a multiple-choice format and 
used terminology which would be under stood^'by pupil's in programs other • ^ 
than the curriculum under consideration. 

The- achievement monitoring tests were administered eight times during 
the school year. The pupils at each grade, level were divided at random 
into four groups and the four test farms at each level were rotated among 
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t\\v. ^;roups so that each group was given a different form of- the test 
for any two consecutive administrations and, over the school year, each 
student took each form twice. The maximum time for any one testing for 
a student was 50'minutes. 

Observations were carried out using the same system as in the 
Phase IV de^scriptive study (Webb & Romberg, 1979). 'Initially, six 
target students were randomly identified in the unit or class. The 
.target students changed over the year, since in some IGE situations 
students are regrouped periodically, making it physically impossible 
to observe the same six students. The' target students were observed 
In sequence using a time sampling procedure. The first student'^was 
observed for a moment and his or her activity was coded. Then the 
next target student was observed for a moment and his or her activity 
coded. The procedure continued until all six target students had 
been observed, taking approximately three minute's, thirty seconds were 
then taken to record the major role of the teacher(s) and general 
activities occurring in the classroom. This cycle was repeated, 
observing each target student in sequence and recording general 
comments, during the time allocated for work on the curriculum program. 
Seven major categories of data were' coded: 

1. General content — time devoted to other than the cur.ricular 

program being observed , 
2i, Specific content — rea'ding skill 

3. Pace — whether or not the student is^working at his or her 
- own pace 

/ ' 
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4. Grouping — size of group of which the student is a member 

5. Materials — the materials being used by the student 

6. Learner moves-rstudent engagement or non-engagement 

7. Interaction — persons with whom the student is interacting 
and the. direction and focus of that interaction 

The event occurring at the moment the target student was observed 
was characterized by checking subcategories '^r each of' these, main 
categories. This observation' system was used to provide measures of 
the amount of time spent in general content areas such as waiting, 
transition, and management and, for specific content areas in reading, 
measures of the amount of time spent by students with different /types 
of groupings, materials, and interactions as well as different, types 
of engagement. 



The observers were trained to use the observation system in a :^ 
four-day training workshop held in Madison in October 1978. The 

-V, V 

first day of the workshop was spent reviewing the -materials and pro- 
cedures used in each of the programs and explaining the observation 
system. Then the observers spent: three days at a school doing observaf^ 
tions and discussing the coding procedures. Percentage agreement on 
individual eveats and intercoder reliabilities on sums over events 
were calculated "to assess the level of proficiency the observers had 
attained in using'the observation procedures (Webb, 1979). .In 
addition, a sataple of schools was visited during the year to check 
the percentage) agreement and intercoder reliability. The observers 
returned for a two-day retraining session in February 1979, most 

■7 . 
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i.f which involved observations in schools to check on the intercoder 

reliabilities, - 

Teacher logs wer^e kept by the teacher who was directly responsible 
for the reading skills instruction of the. students in the target popu- 
lauion. These logs Vere kept daily for six to eight students, including 
those students being observed, in order to obtain a measure of the total 
time allocated to instruction on specific objectives over the investiga- 
tion period. On the logs the teachers recorded the amount of instructional 
time allocated' to specific reading skills, the group size, and type of 
materials used during instruction. 

■ Interviews' were conducted in each school by the observer for that 
school with members of the.Grade 2 and Grade 5 instructional staff and 
with the principal. Background information about the school, the staff,- 
and use of the reading curriculum products was obtained from these 

r 

interviews. The questionnaires' used as the basis for the interviews 
were developed from two sources: the Phase I survey instruments and^ 
the. curriculum developers' questionnaires about product use.- 

Instructional staff provided information about their own teaching - 
experience, how the curriculum product was used, and how the overall 
instructional program was planned and,parried out. Each principal 
■ described the school's organization, its relationship to other educa-* 
tional agencies, and some procedural aspects of the school's ongoing 
operation. < 



Data Aggregation and Scaling 

Literally millions of separate pieces of information were gathered 
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about reading instruction in the schools in this study. The aggregation 
of this mass of .data into scaled variables was no easy task. The model 
given in Figute 2 (Chapter I) had five general categories of variables 
(school, curriculum, classroom jactivities, student pursuits, and pupil 
performance). Then within each category one or more general variables 

was specified (13 in all). ' However, the actual -number of variables into 

/ 

/ 

which the raw data was aggregated was considerably more than 13 for • 
four reasons. First, all classroom and performance data had to be 
aggregated separately for> Grades 2 and 5 in each school,- Second, for 
some general variables (like means of instruction), specific subcate- 
gories (like pacing, grouping, materials, and interactions), had to be 
considered' as separate variables. Third, student achievement in reading 
was considered to be multidimensional , Pupil performance on specified 
program objectives was gathered, which led to aggregation of performance 
data into 12 general content objectives for reading, as- mentioned . h 
However, the related time variables (allocated time, engaged time, 
and non-enga&ed time) were- also aggregated wifeh-respec t to the same 
categories. Fourth, since data were gathered at several points in 
time, all of . the data couT^ also be aggregated in terms of when 

the data were" gathered. % 

i 

The content aggregation for reading skills instruction was used 
with the teacher logs, classroom observations, and achievement monitoring 
tests. The data were^ grouped for analysis at three progressively more 
specific levels, the most inclusave being the ^'content area" followed 
by the "general objective" and the "specific objective." 
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As outiiined in the Wisconsin DesiUn for Reading Skil ls Development 
(WDRSD) (Otto & Askov, 1974), reading skills for which behavioral objec- 
tives are stated are organized into three domains r Word Attack, Compre- 
hension, and Study' Skills. Within each of these content jreas, from one 
to six general. objectives were developed for the present dy . The 
general objectives were based on the specific objectl^s of WDRSD. The 
Word Attack, Comprehension, and. Study Skills aggregations for Grades 2 
and 5 are as follows: (bee Nerenz & Webb, 1980a, P.P. 80-3 for details.) 

Word A\tack: Phonic Analysis-Consonants (01). Phonic Analysis- 
Consonants 'focuses on consonant sounds in real or nonsense words. 
Sounds may be in the initial or final position and include single 
consonants, two- ^^nd three-letter consonant blends, var iant-Qionsonant 
sounds, and consonant digraphs. ' > 

Word Attack: Phonic Analysis-Bowels (02). In this general objective, 
children are to attend to vowels in real or nonsense words. Long and 
short vowels, ^^wels in the final position, vowels plus r, 1, or w, two 
vowels together, and vowel combinations including diphthongs are con- 
sidered. * 

- Word Attack: Phonic Analysis-SiJ^tent Letters (03). Tljis general 
objective asks children identify silent letters and pronounce 
words containing them. Particular attention is given to seven high 
frequency consonant combinations (kn, £n, wr, mb^, _bt, i^, t_ch) , 
nithough silent vowels ^re also considered. 

Word Attack: Structural Analysis (04). Reading skills in this 
general" objective deal with word structure, and- children are asked 



37 



to identify and use pariticuXar inflected forms. This includes skills 

A. 

I 

in seven areasi possessives', rhymes, word structure, plur^fls, 
contractions, word analysis, and special meanings. 

Word Attack; 'Vocabulary Meaning (05). Skills included in this 
general objective deal with the meaning of-. words, generally in a 
particular context. Data were obtained for synonyms and antonyms, 
multiple meanings, and sight vocabulary. . \ 

Stu^y Skills: Map Skills (06). This general objective is designed 
to pi?aVide students with skill^in deriving information from maps. 
It .includes instruction in^ interpreting pictorial and non-pictorial 
symbols, using color keys, analyzing maps and synthesizing information, 
using grids, applying conventional directional systems, using latitudinal 

and longitudinal information, measuring size and distance, and using 

• -/ 
various scaling units.. , 

Study 'skills; Gr .rpb^n^ ^ le Skills (07^^ Helping children 
interpret graphs and tables > ^ :^ focus of this general objective. 
Instruction in comparison, and direct extrfetction, manipulation of 
extracted values, location and comparisoik of cells, and development 
of purpose and summary statements is included. 

study Skills: Reference Skills (08). Skills in t^his general 
objective focus on locating and deriving meaning from varied standard 
reference sources and on recording and evaluating the obtained 
information. This includes alphabetizing, dictionary skills, 
locating information in bo^ks, locating specialized information, 
recording^ and evaluation. 
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Comin-ohcnsion: Word Meanlns Skills (09). This first general 
objective deals witl. skills which help children derive meaning from 
unfamiliar words. Both word analysis and ■ contextual strategies are 



included . 

Comprehension: Sentence Meaning Skills (10). This general' 
Ob iect-ive focuses on'skills which ^ire useful in understanding sentences 

of varied complexity in short written selections. 

\ ' • • ■ 

Comprehension: Passa&t^ Meaning Skills (11). Instruction m 



passage maaning sl^iJls is des^igned to help children derive meaning- 
from longer texts, presented either orally or in writing. Children 
arc to focus on the central thought in passages with and without ^in 
organizer, on tjie sequence of events, and on the validity of outcomes 

or conclusions. ' . " ' 

General Reading (12). This general objective represents the 
three " expres-feive" elements of the WDRSD (CrekpjhB,^ Interpretive, 
and Self-directed Reading) and general enrichment and application 
ai: t.ivi t ies . 

Both log allocated time and observed times were aggregated separately 
for each grade and then r^aggregated according to the three content areas. 
Achievement data, however, were gathered only on a subset of the general 
objectives (see Nerenz. 1980)\ . At Grade 2, ten general objectives were 
measured (Olrjectives 01, 02, 03, 04, 05, 06, 07, 08, 10, 11), and at 
Grade 5, eight general objectives w^re assessed (Objectives 03, '0.4, 06, 07 
qS, 09, 10, 11).- These differences reflect the change in emphasis from 
Word Attack to Comprehension in reading programs between Grades 2 and 5. 



Tims, the pupil performance data" yield 13 variables at Grade 2 and 

'f Hrade 5 (the general objectives measured plus the content areas). 
The potential number of variables is dramatically 'ncreased be- . 
cause of the repeated measures design of the study. All pupil per- 
lurmance data were gathered eight times during the year, teacher .logs 
were kept, and classroom observations occurred in all the periods 
between test times (see Figure 3). Thus, eight different sets of 
achievement data, seven different sets of log data, and seven different 
sets of observational data were available for analysis .. However for 
V^everal reasons, it was decided not to analyze the data at this^ level 
of detail. These reasons included lack of resources, lack of support 
for distinctions between types of schools (see Chapter III), and a 
failure to discern meaningful patterns in the achievement data (Nerenz, 
1980). For this report only achievement data from test time 8 (adjusted 
for test time 1 differences) are presented. 
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October 



May 



Test Test T^st Test Test Test Test Test 
1 2 - 3^ --^.-4 5 6 7 8 



Figure 3. Observation periods and test times for the study. 



All the teacher log and classroom observation data were aggregated 

over the seven observation periods }Xito school year totals. Admittedly 

" i 

this aggregation obscures the fluctuations in content emphasis that 
occur during a year. However, the patterns of emphasis (allocated 
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times to various general content objectives) appear not to be associated 

with IGE or use of WDRSD (Nerenz & Webb, 1980b, P.P. 80-4). 
The actua] variables used in this study are as follows: 
Student Achievement . Residualized mean gain scores (Test 8 

adjusted for differences on Test 1) were calculated . for 13 variables 

at Grade 2 nnd 11 variables at Grade 5 (see Table 2). 



Table 2 . 

SL-udent Achievement Variables for the . lb '.TORSD Comparative Study 



Variable 



Grade 2 



Grade 3 



01 Phonic Analysis-Consonants 

02 Phonic Analysis — Vowels 

03 Phonic Analysis — Silent Letters 
OA Structural Analysis 

05 Vocabulary Meaning 

13 Word Attack 

06 Map Skills 

07 l5ra^h^^and_Tabler"^ 

08 Reference Skills 

14 Study Skills 

09 -Word Meaning Skills 

10 ASentence Meaning Skills 

11 Passage Meaning Skills 

15 , Comp r^hens ion 

12 General Reading Skills 



/ 
/ 
/ 

/ 

01+02+03+04+05 
/ 

/ 

06+07+08 



/ 

/ 

10+11 



■ / 
/ 

I 

03+ OA 
/ 
/ 
/ 

06+07+08 
/ 

,. / 
/ 

09+10+11 
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Student Pursuits . Tiine wa5 used as the unit for describing 
student pursuits. The observed number of minutes coded for tke s o;- .e. . 
of children was Qse^ as the measure of four categories of variable" at 
each grade level: non-applied time, available time, engaged time, and 
non-engaged time. ^ j ^ 

Non-applied time is that time within the designated skills period 
spent in activities which are unrelated to reading skills- \ 
This includes time spent in transition, waiting, management , i break, or 
other academic or nonacademic content area. The^ six types of non- 
applied time were? aggregated into three subvariables: undirected time 
(transition, waiting), supervised time (management, oreak) , and other ^ 
content (other academic or nonacademic cgntent) for each grade level. 

Available time equals the total amount of observed time less the 
non-applied time and thus is that portion,' of the instructional period 
which remains once' undirected , supervised, and other content time have 

been subtracted. As indicated by the variable nane, it Is the time 

/ 

which^is actually available for skills instruction. The total miiiutos 
and percentages of available time were reported in teryis of the 15 
content variables at each grade level. 

Engaged t ime is that portion of the instructional period during 
which students are acti^^ely involved in learning the particular content 
When summed, engaged ::.p.ie and its complement, non-engaged time, equal 
available time. Total minutes and percentage of engagement or non- 
engage-.: -^-nt are reported as the aggregated variables for each of the 
15 content categories for reading at each grade level. In creating 
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these variables, the three types of coded engaged student behavior 
(engaged-writing, engaged -oral , engaged -co vert) were summed. Similarly, 
total non-engagement was created by summing the three categories'^ of 
non-engaged behavior (non-engaged writing, non-engaged interim, non- 
engaged off-task). , 

Classroom Ac tivities , Time was alsc used as the unit for describing 
classroom activities. There are two categories of variables, allocated 
Lime and means of instruction, and both were measured using teacher log 
data and observational data. ^' 

Allocated time is the amount of time in minutes which is designated 
for instruction in reading skills; it represents the total amount of' 
planned instruction for the 25 weeks. Ifi ;-h school, teachers recorded 
tills information in^logs. The tme alloc id by these logs was aggregated 
into the 15 content categories for reading at each grade level. A pro- 
portion of all allocated time was observed in each school. These 
observations were used to check the validity of the teacher's estimates 

of allocated time. ^ - " ' 

Means of instruction includes the teaching., procedures and materials 

used to implement a curriculum program and convey subject matter to the 

learner. Four types of information ^ were coded for each of the 15 content 

categories at each grade. 

Pacing Included either self-paced activities or other -paced activities 



Pacing correlated so highly with Grpuping in the descriptive study that 
separate data h^v Pacing were tabulated for this study (Nerenz , Webb, 
Romberg, & Stewart, 1980"^.. 



no 
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Grouping included one of three group sizes on the teacher logs: 

individual, small group (8 or fewer), and large group/ On the observation 

' ' '' / 

forms, data on student groupings were coded i into one of four categories:. 

. 1 / . 

individual, pair, small group (fewer than 8), and l^rge group. However, 
because pair and small group activities were rarely observed, these 
two categories* wer^ combined, resulting in the - same three grouping , 
categories that were used on the teacher logs. 

Materials used .d^uring instruction were recorded on the teacher logs 
and the observation^. On the teacher logs, four types of materials 
were considered :* WDRSD , text-or other curriculum series, teacher-made, 
and other. Seven categories of materials were considered on the observation 
forms: paper/pencil, manipulative, game, audiovisual, printed material, 
other, and can't tell. Because very /little time was observed in the 
audiovisual, other, and can't- tell categories, these were aggreaged 
-into a single 'subvar iable . Manipulat ives and games were also merged . 
to form a single subvariable, / 

Interactions between the target student and the teacher, other 

/ 

adults, and other students were recorded by the observer. These 

/ 

categories vere combined into two: student to teacher (or other adult) 
and teacher (or other adult) to student. 

Curriculum. Two variables were created to characterize the use of 
the reading program, WDRSD, in schools: curriculum implementation and 
prof^ram customizing. Both are school variables estimated for each 
grade level.' Datacame from interviews with school staffs. 
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Curriculum implementation is a measure of the extent to which 
WDRSD is used. WTDRSD was designed to be compatible with IGE's Instruc- 
tional Programming Model; /that is, it includes instructional objfectives, . 
related evaluation procedures , record-keep ing procedures, and suggested 
instructional activities in sufficient variety that instruction may be 
adapted to student characteristics. Users of WDRSD may choose to use 
*all part^s^oKthe program or only selected element s ; users may also 
choose to use other -products in the same curriculum area, either jointly 
or with one product supplemental to the other (s). 

To develop, a curriculum implementation scale, points were assigned 
differently at Grades 2 and 5, with the total possible number of points 
at each grade level the same. Points were given for use of Word / 
Attack, Study Skills, Comprehension, and other materials in WDRSD. ■ 
To derive a total score for each grade level, points were summed to a 
nun\ber no larger than the maximum number of points assigned for any 
Kingl\ type of implementation . Then, scores for each teacher were . 
summed across all elements to-a maximura of 30 points and divided by .3 ' 
for scores ranging from 0 to 10 (see Nerenz , Stewart, & Webb, 1980 

for de^iails) , , ' 

■ Program customi/ is a measure of alterations made to meet the 
speciiic neeas^ individual students. Three aspects of customization 
were n.easuf^: adaptations to children's instructional needs, provision 
for review and reinforcement, and teacher development of materials. 
Adaptations were defined as changes, additions, and deletions in the 
curriculum program, and two facets of program adaptations were considered, 
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The first is whether the program is adapted to meet instructional needs. 
The second is whether the existence of multiple instructional programs 
leads to duplication bf instruction. Points obtained for these, two 
responses were summed for each teacher.,. Provisions for review and 
reinforcement were considered to be an- essential aspect of program 
use. Points were assigned if provisions for reviewing skills in other 
content areas, application^^^d continuation of skills, scheduling of 
formal skill/review sessions, or frequent teaching and reinforcement 
of reading skills during instruction in other areas were reported. Also, 
teacher development of materials was assigned one point if a teacher 
indicated preparation of special materials. 

Subscores for customizing were summed for each teacher and averages 
were calc\ilated for each grade level in each school. Possible values 
ranged from -3 to 9 (Nerenz, Stewart,. & Webb, 1980). 

School . As described in the IGE Evaluation Project, it was assumed 
that certain organizational features would make it more likely that certain 
desirable instructional practices will occur (Romberg, 1976). Data related 
to this premise were organized into five variables: Interojganizatiohal 
Relations, Procedures Fostering Coordination and Improvement of the 
SchooL Program, Intraorganizational Structure, General Implementatior 
of, the Instructional Programming Model, and Teacher Experiences. These 
describe in detail the organizational structure and staff background 
in the school. A sixth variable. Demographic Background, was also 
included as a description for each school. 
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Interor^^anizational Relations (lOR). This variable is a measure 
of schoot^iCfil iations and staff activities which involve persons and 
organizations outside of^ the school. Subscores were developed for 

(a) school interactions with-parents, (b) district support of the 

. 1 ■ 
curriculum program, and (c) district-wide meetings about program issues 

and, for IGE^ schools only, membership in a regional . group of- IGE schools. 

Teacher scores were summed and averaged for a school score ranging from 

0-6 points. Data <^n district support of the school's 



rending curriculum program were obti^ined front the principal's question- 
naire with a maximum of 3 points possible. .All principals reported 
the frequency of district-wide meetings focused on curricular issues; 
points were allocated differently for IGE and n,on-l"GE schools, although 
each group could receive a possible total of 3 points. An lOR total 
score is a sum of the three subscores and has a possible range of 
Crom 0 to 12 points (Merenz, Webb, & Stewart, 1980). 

Procedures Fostering Coordination apd Improvemen t of the School 
■ L-rogram (COS). This variable is a measure of the school-wide procedures 
and practices which are designed to promote continuity and refinement 
of the overall school program. Scores fo'r (a) , release time for staff 
planning, (b) orientation programs for new teachers, and .(c) inservice 
procedures were developed. A COS total scale, was derived by summing the 
■points for these three elements (Nerenz, Webb, & Stewart, 1980). 

Intraorganization-al Structure (lOS) . This variable is a measure 
of the school's internal organization and the mechanics of its functioning 
Scores indicate the extent to which students and staff are organized into 
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multiaged instructional units and the amount of time available for 
regular meetings of the school's governing body. Unit leaders ii.dicated 
how their schdol organization .was best described: multigrade univs, 
self-contained classrooms with some team, teaching and coordinati on 
within grade levels, or self-contained classrooms. Information was 
also provided by the principal on a chart of school organization. All 
points for reports of multigrade units were developed from thai chart. 
On the organization chart, principals reported-grade range of units or 
teams, number of pupils per unit, and number of uniUs holding regular 
weekly planning meetings. 

An lOS total score is the sum of the school governance ^r.: school 
organization subscores 'yielding a school-wide lOS score of up to 29 

points (Nerenz, Webb, & Stewart, 1980). 

General Implementat^ion of the Instructional Programming Model (IPM) . 

This is a measure of the extent to' which the school is organized around 

the following steps of the IGE Model for Instructional Programming for the 

individual student: 

1. setting school-wide instructional objectives 

2. seiecting a subset of objectives for children in each unit 

3. keeping and using records of asse(ssment results 

4. planning for instruction, including short-term grouping procedure 

5. providing instruction, including variety in materials and in grou 
size 

6. assessing mastery of individual objectives, and 

' 7. .planning and evaluating the overall instructional program 
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Scores were developed by summing seven subscores, one for each of 
the seven steps, yielding a maximum of 120 points (Nerenz , Webb, & 

tewart, 1980) . ^ 
Teacher Experience (TEXP) . This variable is a measure of staff 
teachers' overall experience in education as well as their experience 
in IGE schools. Scal^ values were assigned for each teacher. Results 
were then averaged yielding a school score ranging from 1 to 5 points 
(■iei-cnz, Webb, & Stewact, 1980). 

DemoKraphic Backgrdund (DB) . This variable provides a description 
of the student population of the school. This scale was derived .from 
the national Assessment of Educational Progress (NAEP) which used seven 
Categories of size and type of conununity in reporting results. These 
seven categories (see sampling section earlier) were used to assess DB 
in Phase I of the IGE study and in Phase IV (Nerenz, Webb, & Stewart, 
1980). 



' I lu! Analysi^s Plan 

In light of the re'search questions po'sed at the start of this 
chapter and of the operational problems faced in do ing < the study , a 
four-step analysis plan was tollowed: 

Step l~School Descriptions . Differences in the operating chara£-_ 
teristics among the three types of schools (IGE WDRSD, non-lGE WDRSD, 
and ICE-non-WDRSD) were ^nticipaited to predict differences in the way 
instructional time was used and in tuirn predict student performance 
on specific reading objectives.^ At this initial step, the schools were 
to be described in terms of the school background and program use 
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variables in order to demonstratev that the labeled differences (IGE 



or not, WDRSD or not) were reflected in operational differences. This 

! 

analysis is presented in Chap\:er III.. 

Step 2 — Time Use Difference . The daffererice in how time was 
allocated and used^^in each school at- each qf the two grade levels 



(Grades 2 and 5) was then summarized. The, aixalysis for Grade 2- is 
presented in fehapter IV and .for Grade 5 in Cha^^ter V. 

Step 3 — Student Achievement Differences . The presentation of 



•differences in student achievemerft on each of the content variables 

i 

for each of the schools was the rfext step. In Chapter VI reading 
performance for both Grades 2 and 5 is presented. 

Step 4 — Predictive Analysis . It was planned that student on-task 
behavior (as measured by engaged time) for each \Content objective and 
area in this step would be used as a dependent variable for^each grade 
level and that student performance on content objectivj^s for each grade 
would be used as the dependent variable in a second set of regression 
analyses. However, these regression analyses were not carried out; 
the final number of participating schools made this analysis unfeasible 
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Schools and How They Group 

The, study design specified that triads of schools would comprise 
tha„ sample. VJithin each triad, schools were to represent the same 
demographic setting, differing on use of the WDRSD and on adoption of 
IGE. Thus, within each triad, there was to be one ICE school using 
the TORSD. After school opening in fall of 1978, the urban fringe • 
IGE school not using the WDRSD withdrew from, the study. Remaining 
triads and the schools in each of them — listed in IGE/WDRSD, IGE/non- 
WDRS6, non-IGE/WDRSD order — are as follows? extreme rural. Schools 
372, 466, and 900; small community. Schools 451, 410, and 901; 
medium city. Schools 476, 493, and 902; urban fringe. Schools 507, 
— , and 903. Differences in operating characteristics among the 
three types of schools, background varial?les, were anticipated to 
predict dif f erences |in the way instructional time was used; time use, 
in turn, was anticipated to predict stiident performance on objective- 
based assessments. 

The schools are described by type in the following section. 
After the descriptions, scores on background and program use variables 
are present^^d and discussed. 

' \ 

SCHOOL DESCRIPTIONS 



IGE/WDRSD 

School 451 .' School 451 was one of the two IGE elementary schools 
using the WDRSD in a small micfwestern town. Although the building was 
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composed o£ self-contained cla/^ooms, students were regrouped by ability 
aad skill needs and they. rotatL from room to room for skill instruction. 
l.oii(o were maintained only for the equivalent of one class, all . students 
were tested and four second-grade and six fifth-grade teachers and aides 
wen- involved with the studelits'on a regulat basis. Because of this 

rcv-.rouping, 20 different students were observed at some point during \, 

/ 

the year. ' 

The strongest force behind IGE both in School 451 and in the d^istrict 

as a whole was, the principal. -She believed that IGE was the most 
effective way of meeting individual needs and she spent considerable 

f 

time with the teachers and aides in-order- to make IGE work. This 
r thusiasm was reflected by*" the teachers, and even students recognized ^. 
t - -lationship between their pretest performance and the resulting 

ft 

pai. u - ■ instruction., ]> 

Reading instruction at Grade 2 was provided for two hours daily, 
and skill instruction was given twice a week for a total of 90 minutes. 
Varied materials were . used,^^although the observation notes indicate^that 

J' 

teacher-made materials— primarily worksheets— were most common during 
skill instruction. In addition to these skill periods, instruction _ 
in comprehension and general reading time were also scheduled on a 
daily basis. At Gr^^ide 5, one hour per day was allocated to reading > 
Instruction. Of this time. 90 minutes rer week was allocated to 

skills. . " ' * 

School 466 . School 466 is located iTi a small rurkl midwestern com- 
munity adjacent to a larger city. It is an IGE school with just over 400 
students. Grades 1-6. organized into three units: 1-2, 3-4, 5-6. 
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Tliore were about 55 second-graders in the primary unit and about 
70 f If th-^graders in the 5-6 unit during the 1978-79 school year- 



V7hile only three second-grade and three fifth-grade "homerooms" were 
included in the study, six second-grade teachers and four interns, and 
six fifth-grade teachers and two Jnrnrns actually conducted the classes. 
The^^chool is composed of self-contained classrooms, and students moved 
from room to room for skills instruction. It was noted, howeyer, that 



some students had problems moving among the rooms and to the lai^er 
central open area so that class time was spent taking attendance to be 
sure all group members wer^' present . 

At Grade 2, two hours per day was allocated to reading instruction 
of which .one-half hour was skills instruction provided four days a " 
week. Regrouping occurred every two weeks, with alternating blocks of 
Word Attack and Comprehension skills. Reading instruction was scheduled only 
two days a week'for 30 minutes at Grade 5. ^Students were systematically 
regrouped every six sessions (three weeks). This regrouping explains 
why 14 second graders and 11 fifth graders were observed. While some 
Word Attack was taught at- Grade 5, instruction focused primarily on 
Comprehension skills. A small number of Study Skills were also taught; • 
however, since teachers were using a field test ver^on of those material's, 
they often had difficulty obtaining tests and integra^ng those skills 
V into the updated Study Skills program. 

School 476 . School 476 is located in a medium city in a neighborhood 
of primarily blue collar workers. With nearly 500 students in its K-6 
gradfes, the school is the largest in the district. The building, was 
designed with open areas for flexibility and has three open pods for the 
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1-2, 3-^*, 5-6 grade units as well as self-contained classrooms in eacli 
area. ICR was initiated in the district in response to. teachers' 
desires for greater flexibility for teaching procedures. At one time, 
all four of the elementary schools were termed IGE schools but with 
rrceiU decreases in aides and some conflicts over school structure 
wLtliui the district. School 476 is the only IGE school remaining. In 
addition, the principal expressed concern over what he perceived to be 
a slow decline in "IGE-ness" at even this school. 
/ Most of the teachers at School 476, like those at most other schools 

in the study, reported seven or more years of teaching experience. Of 
the five teachers in the 1-2 unit, two worked primarily with the second 
i^radcrs. Such a division of staff by grade level was also characteristic 
of the 5-6 unit and the teachers noted that students were rarely grouped 

V 

. / 

across ages. " ^ 

In Grade 2, 90 minutes of instruction was provided each day, of 
wliich about 30 minutes was allocat L-d to Word Attack skills two days 
per wcc^k. Reading groups were j^Lso used to teach comprehension and 
general reading skills; however, the "skill" groups and "reading" 
groups appeared to function quite' .lUfferentiy . At Grade 5, two 25-minute 
skill periods were provided each week during the 90 minute daily reading 
periods. Instruction was provided in Comprehension arid Study Skills. 
AUhou?',h sLud'ents and gr9ups rotated between teachers for instruction, 
it: is- interesting that all sbc of^ the target students were observed 
l();;(>t her at eacli observation and tl us the composition of the skill 
j^roups was not substantially altered by the rotation process. 
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School 507 , School 507 is one of seven elementary schools in a 
suburban midwestern school district serving a middle class neighborhood. 
The K-6 school has auouL 55 students in each grade and'^is arranged in 
A units — K, 1-2, 3-4,5-6. It has been an IGE school since 1972 and 
was the first school in the district to use the VJDRSD and to implement 
a systematic skill-based instructional program which emphasized speci- 
fication of objectives and a computerized record-keeping system/ The 
building allow.? a great deal of flexibility in group sizes and 
students moved quickly from one skill group to another throughout the 
' day. Overall, in arranging groups, providing instruction, and maintaining 
records, ef f icieacy seemed to be very important. ^ 

The principal was very committed to the effective functioning of 
IGE at School 507. To that end, he developed the computer system which 
formed the skill groupings and maintained the records, and he arranged 
for aides to be hired in the place of a teacher who was leaving. Like 
the principal, the teachers seemed to understand the "system" of IGE 
and were generally supportive of such an individualized, skill-based 
approach. Teachers at School 507, as at most ether £?chools, typically 
reported seven or more years teaching experience. Teacher aides also 
played an important role in the functioning of IGE at this school. 

The WDRSD was used at both Grade 2 and Grade 5. At Grade 2, skill 
instruction in V/ord Attack was provided for 25 minutes each day, and 
another 85 minutes daily was <?llocated in gen efai' reading instruction 
using another reading serie^j. In the 5-6 unit, 25 minutes was allocated 
no instruction in Study Skills every other day and another 50 minutes; 
to general reading instruction on a daily basis. Students were regrouped 
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overy two to three weeks, and as indicated by the fact that 42 Grade 2 
and 40 Grade 5 students were observr-.d, the composition of these skill 
•.;roups changed dramatically a^. each regrouping. 

ICE/non-WDRSD 

School 372. A K-8 IGE school 'with about 50 pupils per grade, 
School 37 2 is the only elementary school located in a rural midwestcrn 
area. However these demographic cl-.racterist ics belie the actual 
school population in that many ...?i:.'ents commute to work in o." near the 
two large urban areas nearby. Thus, while School 37 2 was originallV 
categorized in the triad of "extreme rural" scjjools, the townspeople 
and the school are, in actuality, considerably more urban. Reflecting 
the diversity of the town itself, the school board is composed of business 
men and farmers who have always lived there as well as suburbanites who. 
have moved from the larger cities. Due to the gradual changes in the / 
school population, the school district has been consolidated so that 
all elementary and junior high students are bused into the expanded 



elementary/middle school building, while the senior high students are 
hused r.o a naw high sdvhool complex in another area. 

Three oi the four teachers participating in the study reported seven 
or more years of teaching experience, while the fourth was in the cate- 
gory of three to six years experience. The principal came to School 372 
\<)7^, and ,it that time IGE was first implemented in the district. 

Instructional groups were based on student ability in reading and - 
mathematics, and, although instruction w^.s always provided in self- 
contained classroom->, children changed classrooms, thns experiencing dif- 
Fc-rent teachers and instructional gr-ips. At School 372, reading instruc 

56 



47 

/- 

tion was allocated 90 minutes per day. This reading time was divided among 
basic word attack skills, spelling, and comprehension . skills with a variety 
of. commercially developed and teacher-made materials being used. The 
principal and teachers seemed very pleased with both the curriculum 
materials and the time allocations. 

School 410 . School 410 is one of two IGE elementary schools located 
in a small midwestern town. The very modern, one-floor building serves 
about 25 pupils in each of uhe school *'s K-6 grades, including all of the ex- 
ceptional or handicapped students in the district. While there were several 
open library and conversation areas in the center of the building, second- 
grade instruction was provided in a self-contained classroom and the 
fifth-grade area was converted into a self-contained classroom using 
folding doors. Students at neither grade level seemed to mpve among 
instructional areas or to teachers outside of their classroom, although 
students were regrouped within each classroom. The number of students 
in the class and the number tested (Grade 2: 25, 17; Grade 5: 23', 16) 
differ because the mains treamed handicapped children were not- 
tested. 

The principal of School 410 was very supportive of IGE -and saw it 
as the most effective way to deal with his very diverse school population. 
He often taught small groups of student^ in particular subject areas and 
worked one-on-bne with many of the handicapped children. The second- 

\ . .■ - 

grade teacher was beginning?, his first year of full-time teaching and 
• seemed to dislike the mechanics of IGE regrouping, and record keeping, 
believing that for only 25 students, the process was too cumbersome. 
In addition to this teacher, a full-time intern v;'orke(J with the. 'Grade 2 
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students for a portion of the observation period. The Grade 5 teacher ^ 
had been teaching for several years and was more enthusiastic about IGE, 
keeping careful records ^f skill groupings, mastery levels, and materials 

used. . 

At School 410, a variety of instructional materials was used in- 
addition to the Scott-Foresman , SRA, and Ginn reading series. Grade 2 
LnstructLon was provided in two blocks— a 70-minute block first thing 
in t'le morning and a 30-minute period just before lunch— and focused 
on word attack and comprehension skills. In addition, students often 
worked out of the Barnell-Loft Skill Series during their free time. In 
Grade 5, reading instruction was scheduled from 8:20 to 9:30 each day 
and focused on vocabulary, spelling, and comprehension. Many teacher- 
made, materials were used at each grade level. ^■ 

School 493. School 493 is located in a medium-sized midwesr.ern 
. city within 15 miles of two other similarly-sized cities, which form a 
fairly continuous urban area. One of eleven K-6 schools in the 
district, it has about 45 pupils in each grade, with 39 second graders 
and 50 fifth graders enrolled during, the 1978-79 school year. Although 
■insiruction was provided in self-contained classrooms, students were 
taught in multi-age groups for reading, math, science, and social 
studies. Only six students were observed at each grade level, however, 
and it appears that students were noc frequently regrouped. 

The school principal was very much in favor of a skill-based 
approach to reading instruction, and word attack, study skills, and 
comprehension skills, were taught at each grade level even though the 
WDRSD was not implemented. The three Grade 2 and three Grade 5 teachers 
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who participated in the study over the entire observation period each, 
reported from three to six years of. experience and primarily use/ materials 
from the Harper and Row or the Economy Series. Few teacher-made worksheets 
were reported by the observer. 

Non-IGE/WDRSD 

School 900 . -School 900 was one of two ele^nentary schools in a rural 
area, in the same town as the district's junior and senior high schools. 
The school included 40-50 childr,en in each grade, K-5. Although 
School 900 was not an IGE school and instruction was provided in 
self-contained classrooms, children were rotated from room to room for 
s \Ms instruction and multi-aged groupings were in evidence. 

The dominant figure within the program was the reading coordinator:' 
She h^j'd been involved in the development of certain activities in Comprehension 
and Study Skills and she seemed to make decisions about program content as 
well as time allocation and the type of skill instructidn provided. The 
teachers who worked with WDRSD were ent hp.>:.lastic about the quality of 
individualization that could be acliieved vith the program, and as shown 
in the data to follow, they used the program in much the same way as 
many "IGE*' schools. The staff was stable: One of the participating 
teachers reported more than three years expe'rience; while the other' three 
reported seven or more. Fev; aides were present, although* the Phase IV 
observer also worked as an aide and was responsible for arranging the 
skill groups and keeping the records. 

For the "unit*' composed of Grades 1-3, 15-20 minutes of skill 
instruction v;as provided four days per week. Instruction in the Word 
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Attack and Study Skdlls elements was provided alternately in two-week 
blocks. In addition to \-JDRSD skill instruction, general reading using 
a variety oC basal readers .vas provided for about 90 minutes daily. In 
Lhc cross-age group foL" '-ourth and fifth graders, the \TORSD-was also used 
four days a veek, v'-.h instruction again provided in Word Attack and 
Study Skills. Other reading series were also used and, as at Grade 2, 
-.Luiledts were regrouped after eight instructional sessions (every two 

weeks) . ' ' 

School 901 . School 901 is the second largest of 77 elementary schools 
in a suburban district and at one time served as many as 1,300 children 
Ln a neighborhood of mixed socio-economic levels. The principal reported. 
20-30% turnover in the student population each year and very 1 ittlexparental 
interest in the school. In each grade, there were approximately 130 
students assigned to self-contained clast,--ooms during 1978-79. Teachers 
participating in the study each reported having seven or more years, 
experience. 

Before coming to School 901, 'the principal had t,aught in IGE 
schools and served as an IGE facilitator and state I'GE coordinator, 
a 'hough School 901 was not an IGE school, he noted that the district 
curricula and aspects of the school functioning had more characteristics 
of IGF. than many schools using the IGE label. School 901 is part of 
a county d istrict 'which has used the WDP3D since the national field 
■ test of the Word Attack element in. 1968, adding the Study Skills and 
Comprehension elements as they became available. Objective-based 
materials with pre- and post-assessment as well as regrouping were 
used in reading, math, science, and social studies. In addition to 
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the classroom teachers, several aides worked at School 901 and each teacher 
was allocated two hours of aide time each day. These aides were responsible 
for some of the mechanics of instruction and also circulated among the 
skill groups during instruction to answer questions and l]elp students with 
seatwork, thus freeing the teacher to focus on her small group. 

The two' second-grade' classrooms are in a small , separate building near 
the main school building and all observations, logs, and tests are based 
on one classroom of 25 students. One hour per day of the 195 minute 
language arts period was allocated for reading skills 'instruction. During 
both on-site visits, a large number, of activities were going on simultaneously 
in the Grade 2 classroom. No more than five children were working on any 
activity at a time, yet students moved from activity to activity in a ' 
quiet and purposeful way. ' . . * 

Since the fifth graders were regrouped for skill instruction with 
fourth and sixth graders and had different teachers for Word Attack 
Study Skills, and Comprehension,- logs were kept by many teachers , and 
many ' students were observed. The children who were observed and for 
whom logs were kept were all from the classroor:t in which tests were 
administered. At Grade 5, three hours each week was allocated for 
Word Attack and Comprehension skills instruction and another two hours 
for skill instruction in. Study Skills. As at Grade 2, several activities y 
and skill "groups occurred simultaneously in the Grade 5 classroom. 

School 902 > School 902 is in a mediuni'psized city and serves a 
population of blue collar workers of medium socio-economic status; 
its location in a valley outside of the town requires the students 
to be bused to the school. The K-6 school has about 60 students in 
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each grade and is organized into three units-K, 1-3. and A-6. Instruction 
L.s still provided in s(il£-contained classrooms, but students are regrouped 
across ages on the basis of a fall pretest. All teachers interviewed 
reported seven or more years of experience, and, while they were interested 
In using the WDRSD, they noted that it was ;'a lot of work." In addition, 
l,c.<-.ause many of the teachers who had received the initial inservice training 
had since left the school, implementing- the 'program as prescribed by tKfe 
school district had become more and more difficult. Thus, during the 
1977-78 school year-the year prior to this study-a comi^£ttee of teachers 
at School 902, including a representative from each grade, clarified 
"operation" of the program in the school, specifying skills to be taught 
and tested "in each grade, record-keeping procedures, and pretest procedures; 
.answers to common question_s were a part of the specification. The committee 
report is strong evidence that staff at School 902 understand the OTRSD as 
a management system for skills instruction. Also during ^his time, the 

■ entire staff participated in cleaning the files, keeping effective 
mntcrials for each skill and discarding those that teachers had not 
1 nund useful. 

All three elements of the WDRSD were implemented at School 902 and 
skills were taught in order (Al , A2 , A3, . . Bl, B2 , . . .) according 

■ to a year-long calendar schedule set up in the fall. The total reading 
block each day lasted' two hours and second graders were grouped with 
third graders for 30 minutes of skills instruction. Fifth graders were 
grouped with fourth and sixth graders for their 30 minutes of skills 
in,;truction in addition to which they received 60 minutes of general 

I ing instruction. Students were regrouped for instruction in a 
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different skill every two weekis, except for a few skills that the teachers 
found to require additional time. 

School 903. School 903 was one of six elementary schools in a 
suburban district serving a middle to upper-middle class population. 
The K-6 school had only 190 students and was to" be closed after the 1979- 
1980 school year. At School 903, variations in the number of children 
per grade resulted in many multigrade groups — only four of the eight 
classrooms had only one grade and it was not unusual for second and 
sixth graders to be. scheduled together in the same skill group on the 
basis of their pretest score. 

Reading skills instruction was allocated one-half hour each day 
and children were grouped according to skill need, with the principal 
and librarian, in addition to the eight teachers, assigned one or 
more instructional groups. WDRSD was used as a supplement to a basal 
series in both units and about one additional hour per day was allocated 
to general reading instruction on the basal series, for a total' of 90 
minutes of instruction. Each member of the teaching staff reported 
seven or more years experience.^ 

SCHOOL SCORES 

Backgrgund variable scores are shown in Table 3 for each . school 
s'lparately; averages for the three school types and the total sample 
are also provided. The first four variables* (lOR, lOS, COS, and IPM) 
represent IGE characteristics; the next two (TEXP and DB) were included 
for descriptive purposes; the last two represent program use. 
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Table 3 



Background and Program L'se Variable Scores for Label Groups 
=^ 



School I0R(12)' IOS(29)' GOS (2^) M (120) TSXM5) M (10) GUST (6) 



ICE/WDRSD 

■451 7.50 

466 5.00 

476 3.50 

507 , 3.00 

Mean 4.75 

SD(n) 1.75 



22.00 


22.00 


94.75 


4.75,. 


"4 


7.25 


2.00. 


25.00 


20.25 


. 75.25 


■ 3,25' 


1 


4.50 " 


, 1.25 


24.00 


9.00 


71.00 


4.7^ 


5 


6.75 


.50 


22.00. 


11.50 


■ 80.73 


' 4.50 


6 


6.25 


.75 


23.25 


15.'69 


80.44 


4.31 


4.25 


6.19 


1.13 


•1.30 


5.54 


8.96 


.62 


1.48 


1.04 


.57 



ICE/non-WDRSD ' • ' 

372 6.00 25.00' 18.50 72.50 ■ 4.75 . 2 0 1.50 

410 6.00 22.00 10.00 75.50 ' 4.50 4 0 2.50 

493' 0.00 25.00 12.00 56.00 ^.00 ^ ' ^* 

Mean 4.00 24.00 13.50A 68.00 ^.^2 3.67 ^0 1. 

SD(n) ' 2.83 1.41 3.63 \ 8,57 .31 1.25 0 .62 

Non-IGE/WDRSD . . ' • , ■ ' / 

i 4.25 1.50 

6 9.25 4.00 

3 7.75 , 2f25 

6 4.00 1.50 

4.75 6.31 2.31 

1.64 '2.25 1.02 

4.27 4.55 1.70 

1.54 ,3.16 .93 



900 


6.50 


15.00 


17.00 


72.00, 


3.75 


901 


5.'50 


16.00 


17.50 


82.25. 


4.00, 


902 


4.50 


U.oo 


16.25 


69.25 


4.00 


903 


9.00 


20.00 , 


19.50 


82.50 


4.00 


Mean 


6.38 


16.25 


17156 


, 76.50 


3.94 


SD(n) 


1.67 


2.28 


1.20 


5.96 ■ 


, .11 


Grand Mean 


5.14 


■ 20.91 


15.77 


75.61 


4.20 


SD(n) 


2.30 


3.94 


4.23 


9.31 


.46 



NOTE: -Variables are defined' on pages 34-38. 

3rs in parentheses indicate maxiium possible score. 
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IGE/WDRSD * , 

School 451 had high backgrou^id variable scores, ranking first on 
GOS and IPM and second on lOR. The lOS score , ranked sixth in a tie 
with Schools 410 and 507; there was also a thtee-way tie for thd highest 
score, program use scores were also high: third for implementation of 
the WDRSD and fourth for reading program. 

Background variable scores for School 466 had no clear pattern. 
On lOS, it was one of thr.^e^ schools with the highest score of 25 out of 
29. Similarly on GOS, School 466 had a score of 20.25- out of 29.00 vhich 
^ ranked second in the study. The school's lOR score was 5 out of 12, . 
seventh, and the IPM score was 75.25, ranking sixth. Program use 
scores were both relatively low. For implementation of the WDRSD, 
the school ranked sixth of the eight users with a score of 4.50 out 
of 10.00, and for program customizing, the school's ran.<: was eighth with 

a score of 1.25 out of 6.00. 

On three of the four, background variables. School 476 had low .scores. 
The exception was lOS on which School 476 ranked fourth with a score of 
out or z 9: 1:he f irst three schools t ied with 25 po ints. On both lOR 
and IPM, the school ranked ninth with scores of 3.50 and 71 respectively . 
School 476 had the lowest GOS score, 9 out of 24, The school ranked 
fourth for implementation of the WDRSD with a score of 6.75. Its program 
customizing score was .5, lowest in the study. ' 

On IPM and lOS, School 507 scored high: 80.7 5 out of 120, ranking 
fourth, and 22 out of 29, ranking sixth because of ties but having the third 
score numerically ."^^ In contrast, the school's lOR score of 3 out of 12 
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ranked tenth and Us COS score of 11.5 out of 2A ranked ninth. A 
simiiar contrast occurred in the program use scores. For implementation 
of the WDRSD, School 507 had a score of 6.25 out of 10 which ranked 
firth. For program customizing, its r.core was .75^out of 6, rank 
tenth. 

lGi:/non-WDRSD 

School 372' s IPM score ranked seventh, 72.5 out of 102. Other 
background variable scores were much hi^har. On both ICR and COS, 
school 372 ranked fourth with scores of 6 ouL of 12 , a t.: e with School 
■AlO, and 18.5 out of 24, respectively. The lOS sc^re of 25, obtained 
by two other schools, was highest in t.he stu.'y. For program customizing 
the school, along with two others, had a score of 1.5 out of 6, the 

ties ranking sixth. 

on thr.ee of the four background variables. School 410 ranked just 
above average: LOR, points, rank 4.5; ICS, 22 points, and IPM. 

,,.,,,^,3, both rank 5. On GOS , the school's score was 10-out of 24 w.. 

ranked tenth. For program customizing, School 410 had a score of 2.5, 

.second highest. 

■ on two of the four background variable;, School 493 had the lowest 
score: Its lOR score wac zero and its IPM score - out of 120. The 
score of 12 out of 24 on COS ranked eighth. For ICS, ..hool 493 wns one 
of the three schools with the high score of 25 out of 29. The school's 
program customizing score was L out of 6 which ranked ninth. ' 



Mon-IGE/WDRSD * 

Background variable scores for School 900 were consistently at or 
^'above the middle of the possible ."^core range; however," the school's 
. ranking among the 11 schools in the VJDRSD study varied considerably. 
School 900 was third for lOR with a score of 6.50 out of 12.00. For GOS, 
the score of 17 out of 24 ranked sixth. The lOS score of 15 on a 29-point 
scale ranked tenth; the IPM score of 72 out of 120 ranked eighth. 

On program use variables, School 900 ranked seventh of the eight 
users on TORSD implementation and sixth of the 11 schools on program 
customizing; scores were 4.25/10.00 and 1 . 5/6 . 00,,;jrespectively . 

Background variable scores for $chool 901 varied widely. It ranked 
sixth on lOR and fifth on GOS with scores of 5.501/12.00 and 17.50/24.00, 
respectively. The lOS score for School 901 was 16 out of 29, which ranked 
ninth. For use of the IPM, School 901 ranked third with a score of 82.25 
out of 120. ' * 

On both program use variables. School 901 had the highest score: 9.25 
out of 10 for use of the ^iDRSD and 4 of 6^^for customizing the program. 

Background variable scores for School 902 were lower than for any 
other non-IGE schools^using WDRSD and below the median for' all 11 schools 
in the study. The lOk score was 4.50 of a possible 12.'00 points and 
ranked eighth; GOS, 16.25 out of 24, rank seven; lOS, 14.00 out of 29, 
rank 11; IPM, 69.25 out of 120, rank 10. These scores are. in sharp 
contrast to those on the program use variable. The school's score of 
\7.75 out of 10.00 for use. of the WDRSD ranked second in .the study; the 
program customizing score of 2.25 out of 6.00 ranked third. 
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'on all background variables School 903 scored higher thin °ther^^^^ 
non-IGE schools using the WDRSD and on three of the four vari^^bles ranked 
.,uitc.-high among the 11 schools in the study. The school's lOR score 
was highest. in the study. 9.00 out of 12.00; GOS third, 19.50 but of 
2A.00; lOS eighth. 20 out of 29; IPM second. 82.50 out of 120.00. On 
program use variables. School 903 had lower scores. For in.plementation 
of the m)RSD, the score was 4.00 .out of 10.00. lowest of the eight . 
.schools using the ITORSD. For program customizing, the score was 1.5 
out of 6.00. a 'score obtained by two other schools; the three schools 
ranked sixth out of 11. ^ ^ 

CLUSTER ANALYSIS 

For both TOR and COS, the non-IGE schools had the highest average; 
Ln addition, for IPM the average for non-IGJl schools was between the 
averages Cor the two groups of IGE schools. Thus, for these three of 
the four IGE-r elated scores, the label IGE school was not useful in 
.roupiag schools.^ Rather than reject the idea that in schools with 
similar operating characteristics instructional time was used in similar 
ways and student . background outcomes were sLnilar, we submitted the 
b,K-kgrou.id variable scores to a cluster analysis. 



If CP ^.j^ developed or disseminated as a simple -new idea. 

Rather IGe'is a synthesis of many existing ideas which implemented 
together, represent a comprehensive alternative, to traditional 
schooling,. (I^or additional information, see '^^^'l^^^^^^-^^ ' 
It is not surprising, then, that schools no t . self-labeled IGE hav(. 
characteristics that one would expect in an IGE school. 
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This analysis groups cases, in this instance schools, into pairs, 
triplets, and so on. The basis for grouping is the scores on the 
variables.. Grouping continues until all cases are combined; at each 
step, the school added to a cluster is the one with variable scores 
^£>last different from the variable scores of the existing cluster. The 
particular program used was P211, cluster analysis of cases (April 1977 
revision), from the Biomedical Computer Program series; developed at 
the Health Sciences Computing Facility, UCLA. Euclidean distance was 
the measure used; all variable scores ^were standardized. 

Two cluster analys^es were carried out. The first used only back- 
ground variables (lOR, lOS,* COS, IPM, TEXP, and scaled DB) . For the 
second analysis, the two program use variables were added. Results of 
both analyses are shown in Figure 4. Schools 476 and 507 clustered 
in both analyses with a combined distance less than 2.00. Other 
pairs emerging from both analyses were Schools 451 and 903 and Schools 
901 and 902. School 493 was a. outlier in both r .es. School 372 
clusrered with School 900 in the analysis using background variables 
only, and with School 466 in the analysis thatj included program use vai'l 
ables. Background variable scores are shown in Table 4 in which school 
are arranged in cluster groups. 

One cluster is composed of the three schools located in very small 
towns or extreme rural areas (Schools 466:*. 372, and 900). Although 
the score for demographic setting is the ordy average distinctly dif- 
ferti'fit from those for other clusters, ^<.tho standard deviation for 
thi'v cluster is quite small for both lOR and IPM and fairly small for 
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Ainai- 
^'.anic'i ted 
distance 

i.U52 

1.064 

i.Jii 

L.586 

1 . I 29 



Schools 



,410 50? 476 



493 451 



90^ 902 901^ 466 -372 ^, .900 



Background variables 



Ama 1 ~ 
jiamat ed 
distance 

L.094 

2.053- 
2. l i-^ 
2. 182 
2.465 
2.525 



Schools 

372^ 466 903 451 900 476 507 493 410 902 901 



l?.u-kj'.r.ui!ul am! nrogrnm use variables 



Figurt' 4. Cluster groups and distances 
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Table k 

I 

Background and Program Use Variables Scores for Cluster Groups 



School 


lOR (12)' 


ICS (29) 


GOS (24) 


IPM (120) 


TEXP (5) 


Scaled 
DB • 


IMPL (10) 

1 


GUST {o);k, 




j.UU 




Zj.UU 






1 JtLJ 


' 3 25 


2 


4.50 


1.25 


3/2 


L nn 
D.UU 


'i^; nn 
Zj.UU 


iO. JU 




h 75 


2 


' '0' 


1.50 


Ann 

900 


0, jU 


1 nn 


1 7 nn 

i/.UU 


79 fin 


3 75 


2 


4.25' 


1.50 


Mean 




' 21.67 


18.58 




3.92 


2 


2.92 


1.42 . 


SD(n) 


« tL 


4.71 


1.33 


1.43 


.62 


0 


2.06 


.12 


4lO 


L nn 


00 nn 
ZZ.UU 


1 n nn 
iU.UU 


/J#JU 


4 1 JU 


A 


0 


2.50 


c m 

50/ 


0 An 


00 nn 

zz.uu 


11. JU 


fin 7S 


4 . Jv 


A 


6.25 


.75 


476 


.3.50 


■ 24.00 * 


9.00 


71.00 


4.75 


5 


6.75 


.50 


Mean 


. 4.17 


22.67 


10.17 


75.75 


4.58 


5.00 


4.33 


1.25 


SD(n) 


1.31 ■ 


Q/, 


I.Uj 


\ Qfi 






3.07 


.89 


A51 


/. jU 


ZZ.UU 


9? nn 


q4 7S " 


■""'^4 75 


4 


7.25 


2.00 


903 


9.00 


20.00 


19.50 ., 


.--■--SOO : 


4.ao 


6 


4.00 


1.50 


Mean 


8.25 


21.00 


20.75 


88.63 


■4.38- 


5.00 


5.63 


1.75 


SD(n) 


.75 


1.00 


1.25 


6.13 


.Jo 


'1 nn 
li uu 


I f\'\ 

I I UJ 


25 


902 


■4.50 


14.00 


16.25 


69.25 


4.00 . 


5- 

c 


7.75 


2.25 


901 




1 A nn 


17 tin 




4 00 


6 


9.25 


•4.00 


Mean 


5.00 


15.00 


16.88 


75.75 


4.00 


5.00 


8.50 


3.13 


SD(n) 


.50 


1.00 


.63 


6.50 


0 


.50 


.75 


.88 


Isolate 


















493 


9.00 


25.00 


12.00 


56.00 


4.00 


5 


0 


1.00 


Grand Meali 


' 5.14 


20.91 


15.77 


75.61 ■ ' 


4.20 


4;27 


4.55 


1.70 


SD(n) . 


'2.30 


3.94 


4.23 


' , 9.31 


.46 


1.54 


3.16 ■ 


.93 



^Numbers in parentheses indicate maximuni possible score. , . > h 
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CdS. Program v;se variables show the same pattern of results. The exception 
Lo the small standard deviation, lOS , is a measure of the paper' organiza- 
tion ol the school rather than the actual operation; for example, lOS 
scores reflect, in part, whether staff and students are organized in 
multlgraded units ratlier than whether instruction is provided to 
muJtigraded groups of students. Three school features are represented 
in ihc I01«: score: parent visitation/participation, district support • 
lor the school's reading program, and regularly scheduled meetings With 
representatives of other schools. GOS scores reflect the quality of 
new teacher orientation (in schools that have appreciable teacher 
turnover), the. extent of inservi^e opportunities, and, with half the 
weigiit of the previous two features, the amount of release time for 
instructional planning. - 

The IPM scores are a sum of ?.even scores, each representing the 

2 

school's implementation of one step of the IPM. Score differences 
rosult almost entirely from differences in implementation of steps 4 
.tnd 3: has is for and frequency of regrouping students for instruction 
and instructional variety in grpup sizes, materials used, and rates of 

)->ro/;ress. 

HKi second cluster of three schools (Schools 410, 507, and 476) 

■'I 
I 
[ 

I 

1 

*^The seven steps are as tlows: 1 . setting schoolwide in struct i<!>nal 
objectives, 2- selecting a subset. of those objectives for students in 
teacher's instructional units, 3, assessing to determine students' 
instructional needs, 4.' planning instructional programs based on those 
needs, 5. providing instruction with variations reflecting both instruc- 
tional needs and learning styles, 6. reassessing to determine effects of 
instruction, and 7. feedback and recycling to the next instructional 
oh/joctive. 

> ■ A 
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is distinguished by low GOS and lOR scores. Both lOS and IPM scores 
are moderate; teacher experience is high. ^ 

High program use scores are common to the tvo pairs of schools; 
however, both schools in one pair have high background scores (Schools 
451 and 903) and both in the other pair have low background scores 
(Schools 902 and 901) . V ^ 

School 493's extremely low lOR and IPM scores separate it from 
any of the groupings of schools in the study. 

Analyses based on these school groupings should be useful tp^^ts 
of the predictions in the study design. On lOR, GOS, and IPM, the 
pair of 451 and 903 has a much higher average than any of the other 
. three groups of schools. The other three groups d'iffer slightly from 
one another on lOR; on GOS the primary di££j£rei^ce is of the triad 
of AlO, 507, and 476 from the other triad and from the pair of 902 and* 
901; differences among the two triads and the 902-901 pair are negligible. 

On both program use variables, the 902-901 pair has the highest 
average, in marked contrast to its low background variable scores. As 
* mentioned previously, the 451-903 pai^ also has high program use 
variable scores compared to the two triads. 

Examination of the background and program use variable scores in- 
dicates that the original hypothesis, that differences in background 
variables among types of schools would-be useful in predicting time use, 
means of itistruction, and pupil performance, is'not sensible to test. 
The labels IGE school and WDRSD user do classify schools, but by. intent 
rather than by actual operation. 
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Time Use in Grade 2 



Time allocated to reading instruction, the amount of time a teacher 
intended to spend in various reading instruction activit'ies, is a gross 
measure of opportunity to learn. The number of hours allocated overall 
indicates tJne relative importance of reading in the elementary curriculum 
at various schools. Broken down by objective, allocated time informs 
us about the focus of instruction at various schools. However, not all 
of the time allocated to a particular curriculum area is active learning 
time for the students. A portion of the allocated time is not applied to 
the planned topic; during this time, students might be making the transi- 
tion from the previous subject, participating in classroom management 
activities, or working on other content. During the remaining time, 
that available for instruction in the content area, all students are 
not always engaged in the instructional activities; some may be passing 
out papers, waiting for. assistance , or simply not paying attention. 

In this chapter, time is first discussed as it was allocated to'the 
general objectives; these data come from teacher logs. Next, observed , 
allocated time is discussed as a proportion of log allocated time.* 



observed allocated time. Finally, data are presented about variables 
representing the instructional process: use of three grouping patterns. 



Available and engaged time are then discussed as proportions of 



use of three di^^erent types of materials, and the relative amount and 



origin of talk in the classroom. 
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Summary tables in this chapter are derived in part from data given 
by Nerenz and Webb (1980, P.P. 80-4 and 80-8) and Webb and Nerenz (1980, 
P.P. 80-5). The tables are arranged by label' group (IGE/17DI<SD^ IGE/non- 
WDRSD, non-IGE/WDRSD) , with cluster group indicated by Tl and T2 for the 
two triplets of schools, PI and P2 for the two pairs of schools, and 
. — (ds > for the outlier. 

Allocated Time 

In the two groups of TORSD schools, generally logs were kept only 
for V/DRSD skills instruction; the exception occurred at' School 901, a' 
non-ICE/UT)RSD school, at which all reading instruction time was logged 
as it was at the non-WDRSD schools. Using reports from the schools about 
the total time scheduled for reading and the proportion of that time 
. allocated to skill instruction, estimates were made of the amount of 
general reading time allocated per child. The estimated total hours . 
oC reading instruction and the assignment of. those hours t(? the eleven 
skill objectives and to general reading are given in Table 5. -In develop- 
ing this table, it was necessary to assume that time for each objective 
was allocated, equally to all children tor whom logs 'were laaintained; that 
is,, if 18 hours were allocated during one period to phonic analysis- 
vowels (02), that time would have been recorded as 3 hours per child 
where logs were maintained for six children, 2 1/4 hours per child where 
logs were maintained lor eight children, and so on. 

Word attack skills (13) received the primary instructional emphasis 
in reading at Grade 2, with most schools allocating from one-half to 
two-thirds of the skill time t^that area. At one of the exceptions, 
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'Tables 

Grade 2 Allocated Hours of Reading Instruction per Child 
over the Total Study 'Period, by Objective 



Phonic Analysis- 
Consonants 
01 



Phonic Analysis- 
Vowels 
02 



Phonic Analysis- 
Silent Letters 
03 



Structural Vocabulary Word Attack 
Analysis Meaning Aggregate 
04 .05 13 



School Cluster 


Hours 


t 


Hours 


I 


. Hours 


/(I 


Hours 


.1 


Hours 


I 


Hours 


I 


IGE/WDRSD 


























466 Tl 


8.3 


19 


9.7 


22 


- 


- 


13.6 


30 


- 


*• 


31.6 


71 


451 ■ PI 


.5 


4 


3,4 


24 


1.4 


0 


- 


- 


3.4 


24 


8.7 


61 


476 T2 


7.6 


31 


5.6 


23 


.1 


10.8 


44 


.2 


1 


24.3 


100 


507 T2 


1.8 


4 


14.2 


34 


- 




6.9 


17 


.6 


1 


23.5 


57 


Mean 


: 4.6 


15 


8.2 


26 . 


^ .4 


3 


7.8 


23 


1.1 


7 


22.0 


72 


IGE/non-WDRSD 


























372 Tl 


28.3 


16. 


38.7 


22 


.1 


0 


36.9 


21- 


8.0 


5' 


112.0 


64 


410 T2 


2.6 


10 


7.6 


29 


.5 


2 


3.9 


15 


1.2 


5 


15.8 


60 


493 


10.4 


19 


8.9 


16 




1 


11.8 


21 


4.4 


8 


36.2 


65 


Moan 


ij. 0 


ij 


18 4 


22 


A 


1 


17 5 


19 


4.5 


6 


54.7 


■63 


non-IGE/WDRSD 


























900 Tl 


.8 


5 


1.0 


6 


1.7 


10 


3.9 


23 


.8 


5 


8.2 


49 


902 P2 . 


5.5 


12 


8.1 


17 


.6 


r 


13.5 


29 


.8 


1 


28.5 


61 


901 P2 


3.0 


3 


19.9 


20 






8.9 


9 


6.3 


6 


38.1 


39 


903 PI 


.5 


' 2 


5.0 


23 




IB 


4.7 


22 


2.6 


12 


12.8 


59 


Mean ' 


2.5 


6 


, 8.5 


17 


.6 


3 


7.8- 


21 


2.6 


6 . 


21.9 


52 


Tl Mean 


.. 12.5 


13 


16.5 


17 


.6 


3 ■■ 


■18.1 


25 


2.9 


3 


50.6 


61 


T2 Mean 


4.0 


15 


9.1 


29, 


.2 


1 


7.2 


25 


.7 


. 2 


21.2 


72 


PI Mean 


.5 


3, 


4.2 


24 


' .7 


5 


•2.4 


ir 


3.0 


18 


10.8 


60 


P2 Mean 


4.3 


s' 


14.0 


19 


.3 


1 


11.2 


19 


3.6 


4 


33.3 


50 


Grand Mean 


6.3 


11 


11.1 


21 


.5 


2 


10.4 


21 


2.6 


6 


30.9 


62 


Standard deviation 


8.1 


9 


■ 10.5 


7 


. .6 


4 • 


9.8 


11 


2.7 


7 


28.9 


15 
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Table 5 (continued) 











Graph 


and 






Study Skills 






Map Skills 


Table Skills 


Rpf pr pnp e 


Skills 


Aggregate 






06 




07 




08 




14 




School 


Cluster 


Hour 


% 


Hours 


% 


Hours 


% 


Hours 


% 


IGE/WDRSD 




















HO u 


J. X 


- 


- 


- 


- 










AS! 


PI 


1'. 3 


9 


I 


I 






L . J 




^ / 0 


1 z. 


















507 


T2 


3. A 


8 


3.9 


9 


- 


- 


7.3 


18 


^ Mean 




1.2 


A 


1.0 


2 




mm 


2.2 


7 


IGE/non-WDRSD 




















372 


Tl 


2.1 


1 






7.7 


4 


9.8 


6 


410 


T2 










.8 


3 


.8 


3 


493 




1.1 


2 


.6 




..4 


1 


2.1 


A 


Mean 




1.1 


1 


.2 




3.0 


3 


A. 2 


A 


non-IGE/WDRSD 


















51 


' 900 


Tl 


2.7 


16 


5.7 


3A 






8.4 


902 


P2 


17.0 


36 


.6 


1 


1.0 


2 


18.6 


39 


901 


P2 


19.7 


20 


8.5 


9 


5.0 


5 


33.2 


3A 


. 903 


PI 


















Mean 




9.9 


18 


3.7 


11 


2.0 


2 


15.1 


31 


Tl Mean 




1.6 


6 


1.9 


11 


2.6 


1 


6.1 ' 


19 


T2 Mean 




1.1 


3 


1.3 


3 


.3 


1 


2.7 


7 


PI Mean 




.7 


5 










.7 


5 


P2 Mean 






28 


A. 6 


5 


3.0 


4 


25.9 


37 


Grand Mean 




A. 3 


8 


1.8 


5 


l.A 


1 


7.4 


15 


Standard deviation 




7.1 


12 


2.9 


10 


2.6 


2 


10.3 


18 
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Table 5 (c'oatlnued) 



Schoor 



[GE/WDRSD , 
466 V 
451 
476 
407 
Mean 



Iv'ord Meaning Sentence Passage (oiiipreliEnsion Total General Total 

fikills Meaning Skills Meaning Skills Agg"Hi:ate Skills Reading SkillsS llours^ 
09 10 11''. i> 12 



Cluster Hours I 


Hours 


I 


Hours 


l 


Hours 


I 


^Bours 
— ^ 




Hou^s 


I 




11 


2.3 


5 


10.7 


Ik 


13.0 


29 


44.6 


23 


178.4 


11 ' 


233.0 


PI - - 


.5 


4 


3.7 


26 


4.2 


30 


14.2 


15 


80.5 


85 


94.7 


17 














24.3 


13 


158.0 


87 


182.3 


T2 


3.4 


8 


7.3 


18 


10.7 


26 


41.5 


23 


141.1 


77 


182.6 




1.6 


4 


5.4 


17 


7.0 


21 


31.2 


19 


139.5 


82 


173.2 



IGE/non-WDRSD 



372 


Tl 


28.5 


16 


6.8 


4 


410 


T2 


2.1 


■ 8 


.6 


2 


493 




3.3 


6 


3.6 


6 


Mean 




11.3 


10 


3.7 


4 



19.0 


11 


54.3 


31 


176.1 


76 


55.4 


24 


231.5 


m 


27 


9.8 




26.4 


41 


37.9 


59 


64.3 


19 


17.3 


31 


55.6 


58 


40.0 


42 


95.6 


lb 


19 


27.1 


33 


86.0 


58 


44.4 


42 


130.5 



aon-IGE/WDRSD 


























84.5 


900 Tl 


















16.6 


20 


67.9 


80 


., 902 P2 










/ *^ 








47.1 


25 


141.3 


75 


188.4 . / 


901 P2 


3.6 


4 


7,5 


8 


./ 14.8 


15 


25.9 


27 


97.2 


68 


45.5 


32 


142.7 ■ 


903 Fl 


.3 


1 


1.9 


9 


/■ .6.6 


31 


8.8 


41 


21.6 


33 ' 


43.2' 


67 


64.8 


Mean 


1.0 


1 


2.4 


4 


5.4 


12 


8.7 


17 


45.6 


37 


74.5 


64 


120.1 


ri Mean 


'9.5 


5 


3.0 


3 


9.9 


12 


22.4 


20 


79.1 


40 


100.6 


60 . 


183.0 , 


12 Mean 


.7 


3 


1.3 


3 


4.8^^- 


15 


6.8 


21. 


30.7 


26 


112.3 


74 


143.1 


PI Mean 


.2 


1 


1.2 


7 


5.2 


29 


6.5 


36 


17.9 


24 


61.9 


76 


79.8 


P2 Mean 


1.8 


2 


3.8 


4 


7-4 


8 


13.0 


14 


72.2 


47 


. 93.4 


54 


165.6 


Grand Mean 


3.4 


3 


2.4 


4 


7.2 


16 


13.1 


23 


51.4 


36 


89.9 


64: 


141.3 ■ 


Standard deviation 


8.4 


5 


2.7 


3 


6.2 


11 


15.8 


15 


47.6 


22 


53.7 


n 


64.4 



Weris are estimates for all WDRSD schools except School 901. 

NOTE: Percentages for objectives 1-11 and aggregates 12-15 are of 
pressed as a percentage of total hours reading instruction, 
is indicated by .0; Of indicates le;ss than 0.5L 



skill time; total skill time and general reading are ex- 
No allocated tiine is indicated by less than .05 hours 
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School 475, the total reading skill Instruction time was given to word 
attack. At the other, School 901^, only 29% of the skill time was 
spei on word aCtack, 

Study Skills (14) were taught very little at the non-lJDRSD scliools, 
and not at all at tliree of the eight ^.TORSn^ Tichools . At three of "the 
iion-lGE/UDRSD schools, study skills were allocatjed over one-third of 
the skills instructional time. 

There seem to be two distinct ic]e;?s about the teaching of 
compreliension skills (15) in Grade 2. Three schools, all schools, 
allocated no time to instruction in comprehension skills. At the 
other eight schools about one-third of the skills instruction time 
was allocated to comprehension. 

The last three columns of Table 5 give skills instruction and 
general reading times in hours and as a percentage of total reading 
instructional time. General reading and total reading hours are 
estirr.itos for all the WDRSD schools except School 901. At that school 
and at the non-V7T)RSD schools, teachers maintained logs for all reading 
instruction. Total reading estimates cover the range of total reading 
a 1. locations. Since the estimates for total reading are based on 
schools' reported schedules and cover the range of allocations for 
total reading, they appear to be r easona b."'. e . The non-^^RSD ^^.hools 
and Scliool 901 reported a much larger percentage of time allocated to 
skills instruction, 61%, than did the remaining seven schools which 
averaged 22% allocated to>skills. This seeming reduced emphasis on 



71 



skills at most c f the WDRT-D schools retlectf a "distinction between 
I'/lJRSD skill instr • lion and skill instruction and application that 



occurs in other components of : ue reading program. At seven of the 
eight \'.T)R:'^D i^^olb, hours .f .'pacific skill instruction appear fewer, 
thiux actually ocr.tivred 

1 * r n po r t io n 0 b s e i •-•ed 

The relationship of lo£, allocated tiine and observed time is 
shown in Table 6, From 16 to '2A formal obsexvations were made 
ill each school dur:-ig the 2 5 -week study. Since testing occurred ii. 
:Six weeks during th pei iod that teachers maintained logs of allocated 
time fo^r the tarf- r V •.■;tudGnts, observations were made in most of the 
remaining 19 weeks, 

Overall J fron 11% to 36% of r.he log allocated time was observed.. 
In most case::), the rel^itlve einpha.sis on general objectives that was 
shown in the logs was maintained in the observations; for example, 
for Objf^ctive CI, little or no instructional time was observed in 
tViose schools in which a small percentage of time had been allocated, 
and a large proportion of time was observed where over 10% of the \ 
inst ructioaal time was allocated to Objective 01. 

At most schools, the correspondence between proportion of time 
allocated and proportion observed is quite close for the aggregate 

oV;.jectives 13, 14, and 15, At School 410, less Word Attack time and 

/ 

more Comprehension time was observed than allocated; at School 901, 
more Work Attack time and less Study Skills time was observed. 





. Table 6 

Relationship of Allocated Time to Observed Time 
by Objective 



Observations 



Total I of Allo- 



- Phonic Analysis- 
Consonants 



Phonic Analysis- 
Vowels 



School 


Cluster 


No. 


Hours 


cated Time 


01 


02 


IGE/WDRSD 












22,28 


466 . 


Tl- 


19 


59.19 


22 


19,27 


451 


PI 


16 


47.12 


Jo 




24,27 


476 


T2 


20 


44.84 


19 


31,28 


23,22 


507 


T2 


.22 


105.38 


32 


4,15 ■ 


34,24 


IGE/non-WDRSD 












22,26 


372 


Tl 


'24 


258.41 


19 


16,15 


410 


T2 ' 


20 


118.55 


29 


10,4 


29,4 


493 




20 


104.70 


18 


19,28 . 


16,9 


non-IGE/WDRSI) 












6,-' 


900 


Tl 


19 


43.09 


32 


5,5 


902 


P2 


21 


42.13 


11 


12,20 


17,19 


901 


P2 


20 


10.U8 


12 


3,6 


20,31 


903 


PI 


19 


46.57 


31 


2," 


23,32 



Phonic Analysiii- 
Silent Letters 
03 



10,23 
0+,- 



0+,- 

2,1 
1,2 



10,23 
1,- 



Structural 
Analysis 
04 



30.12 

o,r 

44,50 

17 „7. 



.21,17 

15,8 

21,1? 



23. .12 
29,24 
9,10 
22,27 



8; 
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'h-:li i (continued) 



Vocabulary Word Attack Graph and Reference 

Meanin::-' Aggregate Hap Skills Table Skills Skills 
School Cluster, , 05 : 13 06 07 Ob 



IGE/ksD 



456 .. 


Tl 




71,68 








01 


PI 


24,21 


61,79 


9,- 






476 


T2 


■1" ' 


100,100 , 








.507 . 


T2 


1,- 


57,46 


3^10 


9^12 




GE/non-WDRSD . 














372 ' 


Tl 


5,7 


,64,65 


1,1 




4,4 


.410 


12 




60,20 


-,1 


",1 ■ 


/ 3,1 


493 




8,14 


65,73 


2,1 


, 1,0+ 


1,1- 


Dii-IGE/MSP'' 














900 


Tl 


5,6 


49,55 


16,31 


'34,12 




902 


. .P2._._. 


, .1,10 


-6y3. — 


-.36,23 


1,^ 


2,- 


901 


" E2,_ 


6,7 


39,55 


20,5 


9," 


5,4 


903 


PI 


12,- 


■ 59,59 
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TabJe 6 (continued) 



^ 







Study Skills 


Word Meaning 


Sentence 


Passage 


Comprehension 






Aggregate 


Skills 


Meaning Skills 


Meaning Skills 


Aggregate 




rl 11Q^PT' 

uXUu LCi. 


14 


09 


10 


11 








• 










AAA 
400 


il 






5 2 


24.30 


29,32 


451 


' Pi , 


9,- 




M 


26,18 


30,21 




T2 . 


""»" 










JyJI 


T2 


18.22 ' 


-.0+ 


8,10 


18'22 ■ 


26*32 


iiit/non-WLiiQiJ 








• 






ill 


ll 






4, J 


11 9 


31,30 




V 

LL 






2 7 


27,47 


37,77 ■ 






4,2- 


6,9, 


6,5 


19,11 


31,25 


non-lGE/WDRSD 








« 






900- 


Tl 


51,43 


--,2 








■902 


P2 


. 39,27 










901 


P2 


34,9 


. 4!8 / 


8^5 


15',23 


27^36 


9C3 


PI 






9,21 


31,20 


41,41 



NOTE: For each general obxv! ive, t'le propHrtion of allocated time is given first followed by the proportion 
of observed time. Per-: rt;igp' of allocated time and of observed cime may not sum to 100 due to round- 
ing. 0+ indicates ] . -SI. 

8ij . 
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Nunappiied Time , Available Time, and Engaged Time _ - 

Formal observations were made durir.g 4:he time period in which 
reading instruction was scheduled in each school. Data on time use 
were developed from these observations. Briefly, the time use variables 
are as follows: no'napplied time, the portion scheduled fov. but not 
devoted to reading instruction; available time, difference between 
scheduled observed time and nonapplied time; engaged time, the portion 
ol available time that students vere observed to be attending to 
inst:ruct ional act: Lv i c : c:; . (These variables are described in more 
detail in Chapter II.) 

As shown in Table 7, the percentage of nonapplied time khd , of 
course, available time varied among schools. Little nonapplied time 
was observed in the three schools in T2; members of no other cluster 
group and no label group were consistent in percentage of nonapplied 
t ime . 

At all schools, students were engaged in instructional activities 
over half of the allocate time, with the highest percentage of engaged 
time at the three schools in Tl\ Again similarities were not found 
ainoung members of other groups. 

The allocatecl instructional hours for each child from Table 5 
and the overall percentage of engaged time from Table 7 together pro- 
vide OS imates of the time allocated to reading instruction each 
week -uul t. he average engaged time f^r each child (Table 8). 

Five schools reported allocating less than five hours a week, or 
one hour a day, to reading instruction. These schools represent all 
three label groups and include both members of 'PI, Schools A51 and 




^ Table 1 
!]onapplicd Time, Available Time and Engaged Time as a 
Percentage of Observed Allocated Time, Grade 2 



J ^ , _ 

Available Time " Engaged Time 





• 


Nonapplied 


Total 


Range for 


Total 


Range I 


School 


Cluster 


Time 


Study 


Periods A-G 


Study 


Periods i 


IGE/MDRSD- 


t 


• 










466 


Tl 


22 


78 


71-86 


53 


46-70 


451 

J- 


■pi 


16 


84 


68-100 


62 


46-80 


476' 




7 


91 




68 


59-74 


SO? 


T? 


7 




R7-97 


11 

1 1 


65-77 


I lea 11 




ij 


fi7 

0/ 




64 




IGE/iion-WDRSD 
















Tl 


li 


ou 


7M? 


62 


58-71 




, TO 


1. 
J 




Q?-100 


77 

/ / 


69-82 








/ 0 


0/ 


66 


49-80 


Mean 




12 


88 




68 




nOil-iljL/l^UKoU ^ 
















Tl 




7n 


41 00 




29-85 


902 


P2 


26 


74 


52-90 


63 


42-88 


901 


P2 


'J 16 


84 


75-90 


54 


46-67 


903 


PI 


14 


86 


77-100 


55 


51-70 


Mean 




22 


78 




58 




Tl Mean 




22 


78 . 




'58 




T2 Mean 




6 


94 




72 




PI Mean 




15 


85 




59 




P2 Mean 




, 21 


79 




59 




Grand Hean 




16 


84 




63 




^X^"dard deviation 




8.4 


8.4 




7.5 
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Table 8 

Estimated Hours Allocated and Engaged for 
Each Child Each Week, Grade 2 



Hours Alloc d per Child 



Sch'^''l Cluster Total Stud ^^ Per Week 



IGE/WDRSr 



466 


Tl 


223.0 


9. 


32 


53 


4.94 


451 


PI 


9A.7 


3. 


,79 


6.2 


2.35 


476 


T2 


182.3 


7. 


29 


68 


4.96 


507 


T2 


ia2.6 


7 . 


,30 


71 


5.19 


Mean 




170.7 


6. 


93 


64 


4. 36 


IGE/non-WDRSD 














372 


Tl 


231^5 


9. 


,26 


62 


5.74 


410 


T2 


6A.3 


2 




77 


1.98 


493 




95.6 


T 


82 


66 


2.52 


Mean 




130.5 


5, 


. 22 


68 


3.41 


non-IGE/WDRSo" 














900 


Tl 


84.5 


. 3 


.38 


58 


1.96 


902 


P2 


188.4 


7 


.54 


63 


4. 77 


901 


P2 


142.7 


5 


.71 


54 


3.08 


903 


PI 


• 64.8 


2 


.59 


55 


1.43 


Mean 




120.1 


4 


.81 


58 


2.81 


Tl Mean 






7 


.32 


58 


4. 21 


T2 Mean 




"j.l 


5 


.72 


72 , 


4.04 


Pi Mean 




,9.8 


3 


.19 


59 •' 


1.89 


P2 Mean 




165.6 


6 


.63 


59 


3193 


Grand Mean 




142.2 


5.69 


63 


3.54 


Standard 




64.45 


2 


.57 


7.5 


1.58 



deviation 



^Prom Table 5. 
'('rom. Table 7. 



Engaged Time 



Estimated 
%^ Hours/Week 



7H 



903, one member each of Tl and T2 , Schools 900 and 410, and the outlier, 
School A93. Kngaftecl time at these schools ranged from one and one-half 
CO two and one-half hours a week. Engaged time uses about five or more 
hourr, a week at all other schools except School 901, at which it was 
three hourfi a week, 

M can.s of Instruction 

The I^'^. Instructional Programminfi ^del pr .vides for the use of 
a variety of group sizes and of instru^i^tional materials to meet children's 
individual instructional needs. The WDRSD was developed to be consistent 
with the IGE philosophy. Thus, all sch; .Is T-r" e .j^ected. to use a variety 
of group sizes and typ9,s of materialr,. ^Only the' skill development 

aspect of reading instruction is includeli .r. che WDRSD, with the 

\ 

developers expecting that a total program would worked out at the 
local level (Otto & Askov, 1974). In the\ WDRSD schools in which only 
formal skill instruction was logged and oLerved, there is no infortnation 
about instructional time with a basal readlr series or in language 
experience groups; in both of these instanqes, data for che WDRSD 
schools would provide underestimates of Chel. time students spent in 
small groups and, in schools using a basal ^eader program, underestimates 
of the time that print materials were used. \ Since ^student interactions 
should increase with increased, use of small 'groups, underestimates 

of the use of small groups will be accompanied by underestimates of 

I ; 

.siiuu:;!:'- interactions. j 

Ost of the three group sizes and the three primary types of materials 
aiv.i inr dence of teacher and student interactions are summarized in 



'I\iV*- y art percentage of available time. Of a] 1 cluster groups 
and label groups, bnl.y the pair of Schools A51 and 903, PI, consistently 
ustnl instructional group sizes wi . similar frequency. At all ICE/WDRSD 
schools large groups were used extensively but the scltools differed in 
llicir use of individual and small groups. Similarly, at all IGE/non- 
WDRSD schools, individual work was predominant but siaall and large 
groups were used for different percentages of time at the three schools. 

In use of materials, the only consistently similar ^hools in a 
label or cluster group were, again, the members o« , The schools 
at v;hich all reading time was observed, IGE/non- ^chool s and 

School 901, appear to use print materials mor^ lutm other schools, for 
the reasons mentioned above. At six of the ei^ »>/DRSD schools 

/ 

manipulatives were used more than the minimal rcentage observed at 

/' 

the non-WDRSD schools, / 

-/ 

In incidence of interactions, again only for cluster group PI 
were observations of group members similar. A lower incidence of 

/ 

teacher interactions was observed at the non-WDRSi3 schools and School 
901 than where only formal skill instruction was observed. 




Group Size^ 



Cluster' .Jridividual Small Large 



Materials 



Fa'per-and- * ( 

^ Pencil ' Manipulatives Print 



Interactions 



"Teacher. Student 



Tl . 


19 


4 


77 


PI • 


31 


13 


56 


T2 


26 




72 


T2 


41 


■ , 0+ 


59 




. 29 


. 4 


66 



t2 ( \ 



64 


15 


21 


56 


.42 


, 2 


49 


1 


51 


56 


19 


*25 



53 
82 . 

54 

■64* 

63 



64 

6^ 
56' 
63 





Tl 


29 


,10 ■ 


61 


52 


i 


P2 


49 


" L. 


49 


56 




P2 


55 


16 


29 


70- 




PI 


•36 • 


, 9 


53\ . 


79 


/ 




• .42 


9 ; 


48 ' 


■64 ' 








10 ' 


53 


56 






. 41 


14-. 


44 ' 


62 






34; 


.11 - ' 


55 ' 


81 






52 


9 , 


39 \ 


63 


n . 


;v 


41 


. 1 


48 . . 


6j 


deviation 






12. V 


22. 


10 :j 



1 

0+ 



9. 
•26 
6 

'8. 
12 



1 
7 

•16 



4 


. ■ 31 


8 


- 


31 


15 


. 3 


45 j 


.10' 


7 ■ 


31 • 


11 


4 


35 


11- 


35 


■ 14 


13 


60 


15 


20 


37 


20 


15 


44 


16 


16 


4" 


46 


11 


3 ' 


36 


18 


23 I 


15 




0+ 1 


. 32 ■ 


12 




32 : 


13 








14 


30 


11 


23 


: , 30 


14 




32 


14- 


• 13 


26 


•14 








16 ' 


29 ■ 


13 


20 


11 • 


4 



9^ 



may not sum to 100 due to rounding/ ; 
heed not sum to 100. / 
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Time Use in Grade 5 

^ . • ■ ' M 

Time allocated to reading instruction, the amoi^nt of time a' teacher- 
" intended to spend in variojis reading instruction Activities, is a gro^s 
measure of opportunity' to learn. ^ The number pf hours allocated overaU 
.indicates the relative importance of reading 'in the elementary curriculum 
at various schools. Broken down by objective, allocated, time infornA ' 
us abLt the focus of instruction- at various schools. However', notjall 
of tne time allocated to a. particular curriculum area is active learning 
time, for the students. A portion of the allocated time is not apjplied to 
the planned topic; during'^his time, students might be making the'transi- 
t Ions from the previous subject, participating in classroom^ management 
activities, or working on other content. During the remaining tiirie 
that. available for iijstri^ct ion in the content area, all students are 
not always engaged in the instructional activities; some Aiay. be "passing 
cue papers, waiting for Assistance, or simply not p'aying atten^tior^;. ' 

In this'chapter.'time is first discussed as it was allotted to the " 
general objectives; these data come from teache^logs. Next, observed 
allocated time is (^scussed as a'proportion of log allocated time\ 
Available and Engaged time ar^ then discussed as proportions of 
observed allocated'-trime. ' Finally, data are presented about variables 
representing" the instructional process:' use of 'three grouping patterns', 
use of three different types of "Materials, and^ tHe relative a^J^ui^t and 
origin to talk in the a^ssroom, • ' 



Summary tables in this chapter are derived in part frcm data given 
% by Nerenz Webb (P.P.. 80:^4 and ^ 80-8) and Webb and Nerenr^ (P.P. 80-5). 

3 T" ""^^^ 7 

The dntrdduction (and much of *the text of this chapter are repeatpd for 
the benefit of those readers who may not have read^ Chapter IV. 

« - • ' 81 '• 99 ■ ■ 
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The 'tables are arranged by label group (IGE/WDRSD, IGE/non-wi)RSD , nbn-IGE/ 
WDRSD), with clusce^ group indicated'by Tl and \T2 for- the two triplets of^ 
schools, PI and"? 2 5oV* t)ie two pair of sc^opls, and — (dash) for the outlier. 



Airocated Tline 

In the two groups^'of WDRSD schculs, generally logs were Kept only ^ 

'for WDRSD Iskills instruction; the exception occurred at^ School 901', a 

^' V \- : " K • ' • 

non-IGE/WDisD schopl, at which all reading- instruction time was- logged 

^ ^ \ 

a)s it was at the non-WDRSD schools. Using reports ftrom the schools about 
• • , f ' ■ . 

the total time scheduled for reading and the proportion of thaf time 

allocated^to sk x.1 instruction, estimates .were made of the. amount of 

general reading time allocated per child. The estimated total hours 

of reading instruction and the assignmen,t of those. hourg to the 11 ^ • 

" « . \ ■ V 

skill objectives anc^^ to general reading are given in Table 10. In . 



developing this table, it was nedessary to assume that time for each 
ob^ctive- was allocated - equally to all children for whom logs were' 



maintained^ " that is, if IS^hours were allocated during one-period to. 
word meaning skills (09), that time would .havec.been- recorded as 3 
'hours per child where' log^ were maintained for six children, 2 1^4 - 
"hours per child w'h^re logs were maintained for eight children, and 
so on . t ,^ ' • / ' 

Word Atta-ck skills were, taught in all four of the schoqls in 
which. all reading time was logged — 372,-410, 493, and 901— and in 
School 466. The^Word Attack element of th^ V7DRSD was developed -to 



end formal skill instruction, indep^dent of a .basal reader or other 
series, at third or fifth grade depending on students^^reading abili't} 
These results are consistent wich the developers' expectations. ^ 
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. -The five schools that provided Word 'Attack skill ' instruction 
allocated a relatively smaller pronortion of their reading time to 
Stiidy Skills than did other schools. At' School 903 ho time was, allocated 
to Study Skills during the skill period. In contrast, at School 900 
^virtually all skill instruction time yas allocated to" Study SkillsV 
' In 9 of the 11 schools, about half of the reading skill -instruction 
time.ac Grade 5 was'-allocated to Cbmpi;ehension skills. The.tvo ^ - 

exceptions differed not only from the other schools but also from one 
another. At School 903, nearly all of' the skill instructJLon f ocuse^ ^ ^ 
on Comprehension; "Mt School 900, no skill time was allocated ,to . : 
Comprehension. ' » ' - • . ' 

The last three col^urans of Table lO^^giye skill ingtruction and. 
general rea'ding times in hours and as a percentage of to t^i. reading 
ii^sur^ctional ^t ime-. General reading and total reading hours are estimate 
tor all the WDI^SD schools except Sc-hool 901. At. that school and at the 
non-WDRSD schpols, teachers maintained logs for all reading instruction. 
Total reading, estimates cover the range of tqtal reading allocations., 
^^ce the estimates for total reading are based on schools' reported 
schedules 'and cover the range of allocations <(for total reading, they 
appear to^be reasonable. Trie non-WDRSD schools and School 901 reported 
a, much larger percentage of time allocated to .skills instructionj* 57%, 
than did the remaihing seven schools which .averaged 21% allocated to 
skills. This,, seeming reduced* emphasis on skills at most of the WDRSD 
schools reflects a dist inct ion between \JDRSD skill instruction and skill 
instruction application that occurs in otjier components of the reading 
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Table 10 



Clus ter 



. 'Grade .5 Allocated Hours' of Reading Instruction per Child 
^ ' - over the Total Study Period, b7 Objective 



col 



Phonic Analysis-- ^ Phonic Analysis- 



Consonants 
•Hours ■ 7o 



'Vowels 
02 

Houris 7„ 



Phonic Analysis— ^ Structural Vocabulary Word Attack 

Silent Letters ' ' Ang^lysis Meaning ; Aggregate 

' 03 ^ ' . 04 / 05 13 ■ 

' Hours % Holirs % Hours % Hours- % 



t 



Tl 
PI 
T2 
T2 



Tl. 

T2 



.5. 



4.81 



.9 6 



5.8 ,6 

1.4 r7 2 

.3 1 



1.4 



.1 0+ 
.1 0+ 



3.8 . 24 



14'. 8 ■ 15 
.8.5 15 
4.2 14 



6.6 41 
-_\ 

1.7 . 10 



1.6 2 . 27.1 . 28 
6^.2 U 16.2 ■ 29 ■ 
2.0 • 6 



6.9 22 
16.7 26 



5D 



Tl 
P2' 
P2 
•PI. 



,.1 0+ 



2.5 3 



.1 0+- 

9.1 11 
.7 ■ 3 



0+ 



U.7 14 
.7 3 
1.1 2> 



11.3 23 
5.4 10 
5^9 ^7 



viation 



6.3 12 
8.9 15 
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• Table ^0 (coofinued) _ 



■Graph and ^ ' Study "Skiy.s 

Map Skills Table Skills Reference Skills Aggregat| 



06 ■ Oi ' 08 / 14 * 

Hours % 



Cluster . . Hou{^ % • Hours ' % ' Hours Hours % 



. ' - ' V 

Tl' - - . 1.5 9 • .9 ■ 6 

Pi - 1.1 11 , - • - '4.8 49 

T2 ,2.9 13 . -5.0 23 ■ 1.9 9 

T2 . 3.6, 12 9.4 . 30 " 3.9 12. 



Tl .8 1 ..2 0+ ' 9.8 ' 10 

T2 , 1.5 3^ .5 1 ; 3-3.7 24 

- ' 1.1 ' 4" .3 1 7.9 ^6 



" c 

Tl 4.4 .30 2.9 20 7.3 , 50 

P2 8.0 22' 6.5 18.- - 2.6 ' '7 

P2 
PI 



P2 . 4^8 6 • 6.2 8 20.9 ■ 26 



- 'I 



/ 

\ 



/ 



2-. 4 


15 


5.9, 


60 


7.0 


t J 




SA 


'8.8 


44 


r 

10.8 


11 


15.7 


28 


9.3 


30 


11.9 


23' 


14.6^: 


LOO 


17. r 


46 




39 


15 i9 

■ \ 


46 


I 

9.3 


42 


14-. 1 


42 


3.0 


30 


24.5 


43' 


12^.2 j 


39 


8.7 ' 


27 



iO.j 





1- 


r 






. Table 10 (continued)' V 






00 


k-. ; : 1— 

Word-iMeaning 
. ^ ■ * Skills " 

09 : 


^ejatence"* Passage* 
Meaning Skills >^eaningvSkilI>s 
■ . 10. ' 11 • 


Comprehension 
/Aggregate 

■ f 


Tot4 
Skills 


General Total 
• Reading Skills^ Hours^ 
12 . 


Cluster . Hours % 


Hours % 1 Hours % 


Hoi^s % 


Hpurs / 


i . ^ Hours % • • 



D 



PI 

T2-J 

T2 



Tl 

, T2 



2.9 18 

.8 8 

3:3 ■ 15 

4.8 .15 

31.5 '32 

14.0 25 

5.0- 16 



1.6 



•4.3 
1.5 
2.1 



U .26 



24 
9 
7 



32 
32' 
29 



25' 

17 

25 



7.1. 

3.9 
11.8 • 
14.4 

9.3 ' 



60.3 
24.9 
f4.7 
33.3 



44 
40 
55 
'46 
46 



61 
44 
48 
51^ 



16.1 
• 9.8 
21.6 
31.3 
1^.7 



13 
30 

ii 

17 
18 



98'.2 67 

56.8 /5^^ 

30.9 • 35 
'62. 0' 51 



104 .'7 
22.8 
172.8 
156.5 
114.2 



48^.2 
56.9" 
57.9 
54.3 



C87 
. 70 
89 
83 
82 



-_33 
50 
65 
49:. 



120 ra 

32.6 
194'; 4 
187.8 
133.9 

146;4 
113.7 
88.8 
116.3 



%1 
P2 
P2. 
PI 



iation 



10.3 28 
1^^3 24 
1.0. 5 



6.2 
1.9 



10 



9.5 
12.1 
16.2 



2-6 
15 
85 



19.8 
,37.6 
19.1 
19.1 

22.5 
17.0 

1;l.5 

28.7 

19.4 
17.1 



54 
46 
96 

49' 

"35 
48 
68 

' 50 

■49 
22' 



14.7 13 

36.9 33/ 

81.2 . 11 
19.8 

38.2 /39 



37.9 
28.9 



34 
22 



94.5 
73.8 
24.7 
39.6 
58.2 



43.0 31 82.5 
.36". 6 26 * 128.7 
14.8 32 31.2 

59.1 55\J '49.3' 



77.5 
50.2 



.87 
67 
23 
67 
61 



69 
7A 
69 
45 

66.. 
22 



109.2 
410.7 
105.9 
59.4 
96.3 



125.5 
165.3 
46.0 
108.3 

115.4 
48.3 
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estimates for all WDRSD„ schools except ^chool 901. 

ntages for ob^jectives 1-11 and aggregates 13-15 are of skill time; total skill' time and general reading are ex- 

ed as a perq^jtage of total hours- reading instruction. No allocated time is indicated by less than .05 hours 

; 0+ indicate less than '"0.5^..^ ' . > ^ \ ^ < ^ 



EKLC 



prograiji. Xt seven ^of the eight VJDR&U schools', hour§ of specific 
skill instruction' appear fewer fcl^an-' actually occurred, • ^ 



Proppjafe4e/h Qb served 
^ The rela-tionship of log allocated .tiipe and abserved ' time is' shown 
in Table 11. From 15 to 21 formal observations were made' in each " 

^ . ■ ' ' ' ^.^y 

school during fhe 25-7week study. Since testing occurrecO-i^. six weeks = 
during' the pexiod that ' teachers maintained logs of allocated time for ^ 

^ the target students, observations were made in-~most of the ' remaining 

^ 19 weeks* ' ■ 

^ Overall, from 11% to 56% of the log allocated time ^?as «observed , 
In most cases, the relative emphasis on general objectives that was 
shown in the logs wag maintained . in the obset>vations; for example, 
for Objective 08, little Qix no instructional time was observed in' 
those schoo-ls in which a siriall percentage of tirae had been allocated, 
and a large proportion of time was observed where over" 10% of the • > * 
instruct'ional time was .allocated to Objective 08 , / • - 

. ■ • . At most schools, the correspondence betweap proportioa, of- time * ' 
allocated and proportion observed /is quite close for the aggregate 
Objectives 131 lA , and 15, At School- 410,' less Word Attack time and • 

more Comprehension t^ime was observed than allocated; at School 901, 

• . % . . ' . ■ 

Xe^s Word Attack knd Comprehensltin time and more* Stud^i Skills time 
' * • ♦ ♦ ' .\ • , 

"was observed, 



Nonapplied ^Tirne, Available Time and Engaged Time ' ^ 

Formal observatioq^s were. made during the timfe period in which • 
reading instruction was scheduled in each school,/ Data on time use 
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Table. 11 > 
Relationship of Allocated Time to Observed Time 
by Objective • . 
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00 



Observations 



Phonic Analysis— Phonic Analysis— Phonic Analysis— 







Total 


I of Allo- 


Consonants 


Vows Is 


Silenf Letters 


Cluster 


No. 


Hc'-irs 


cated; Time 


or , 


02 


03 








/ 








■Tl 


15 


43.90 


• 44 




6,6 


9,- 


■'. n 


1'6 


56.89 


56 




> 




• T2 


20 


68.86 


30 


J — — 






■T2 


■ /O 


64.65 


25 • 


/— 1~ 




> 








{ 








' Tl ■ 


21 


166.32 


19 


5,9 


6,6 A 


0+,0+ 


T2 


21 


93.25' 


14 


> 


■2,0+ 


0+,- ■ 




20. 


82.36 


12 


1,- 




) 




























' Tl ■ 




52.91 


45' 






J 


P2 , 


19 


46.22 


11 


-,0+ 




J 




20 


91 .^^ 


14 


,0+.- 


. 3', 0+ 


— - J — - 


PI 


20 


4'6.19 


■ 38 






"""" 1 



Structural 
Analysis ■ 
04 . 



fl!DRSD 



24,37 



-.2 



15,16 

15,6 

14,5 

t 

0+,10 
3,- 
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Table 11 (continued) 



School 

IGE/WDRSD 
466 
451 
476 
507 



■IGE/non-WDRSD 
3-72 
410 
493 



non-IGE/WDRSD 
, 900 
\ 902 
I • 901 
903 



Vocabulary 
Meaning 
Cluster ' 05 



Word Attack 
Aggregate 
13 



Map Skills 
06 



Graph and 
Table Skills 
07 



Tl 
PI 
T2 
T2 



Tl 

T2 



Tl 
P2 

P2 

PI 



2.5 
11,1 , 
6i0+ 



41,43 

-a. 



28,36 

29,8 

22,5 



0+,10 
— ,0+ 
14,7 
3,— 




1,1 

3,3 
4,9 



30,12 
22,29 
6,1 



9,1 

23,'l3 
30,22 

0. 0+ 

1, -- 
1,— 



2(f,i24 
18,13 
8,14 



Reference 
Skills 
08 '• 



6,- 
49,51 
9,3 

12;,19- 



10,12 
24,16 
"26, 2\ 



50,47 

7,6 
26,41 



\ 



Ill 



3 
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Table 11 (continued) (\ 







^ Study Skj.ll.s 


Word Meaning 


, Sentence 


Passage 


Compi 






Aggregata 


Skills 


Meaning Skills 


, Meaning Skills 




School 


Cluster 


14 


09 


10 


11 tj/ 


/ 


IGE/WDRSD 




! 






• ' — j' 




466 


rT^l 


/ .15,7 ■ 


18,24 




26,26 ^ 




451 


PI 


' 60,51 


9,16 




32,34 




476 


T2 


45,53 • 


15,10 / 


7,- 


32,34' 




507 




54,57 


15,22 


3.1 


29,20 




IGE/non-WDRSD 






, 1 




V 




372 




11,13 " 


^32,35 




25.20 




410,, . " 


■ T2 


28,19- 


25,43 


3,6 


17,25 




493<.. 


* 


'30,30 


16,30 ' 




25,30 




non- IGE/WDRSD 








. . r 






900 • 




' , 100,82 


-.7 








902 


P2 


r 46,48 


28,40 








901 ' 


P2 


39,56 


24,26 - 


'•"sir- 


15,9 




903 ' 


{il • 


» 


5.5 


• 10,4 


85,91 





NOTE: For each general objective, the proportion of allocated time . .iven-f'irst followed by the 

of observed time. Percentages of allocated time and of ob'servea time may no^t sum to lOO' due t 
ing. 0+ indicates less than 0.5%. * 
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were developed from. these observations. Briefly > the time use variables 
are as follows: nonapplied time, the portion -'scheduled for but- not 
devoted to reading instruction; available time, difference between 
schedijiled observed time and nonapplied time; engaged time, the portion 
of available time that students were observed to be attending to 
instructional acclivities. (These variables are described in more detail 
in Chapter II.) i , - 



As shown in Table 12\ the percentage of^ nonapplied time and, 



of course, mailable time varied among schools, averaging 19% of the 
allocated- time. The extreme deviations occurred at Schools 466 and 

\^902^where nearly one-third of the allocated time was nonapplied time, 
a\d School^'Aip, where only ^% of the allocated time was nonapplied. 
These three except ional ' schools account for the apparent differance ^ 
of the non-WDRSb schools from the two groups of WDRSD schools and of 

: T2; both members of PI had a lower than average percentage of nonapplied 
time. • 

. Students were engaged in instructional activities nearly two-thirds 
of the time,, on the average. School 466, at- which students were en- 

gaged only 50% of the time, and School 410, where students Were 

' I > ' ' 

engaged 89% of the time, were again exceptional. At School 900 ^ where 

the percentage of nonapplied time had been average, engaged time was 

only 55% of the allocated time. Again the exceptional schools account 

for the apparent differences among label groups and cluster group,^. 
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. Table 12 



Nonappli^d Time, Available Time and Engaged Time as a 
Percentage Observed Altocated Time, Grade 5 
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89 
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65 


14 
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19 


' 81 • 


'64-92 , 




55 


29' 


71 


55-90 




. 59 


20 


80 


70-93 




61 


10 


90 


- 4 73-87 




65 


21 


79 






' 60 


23' 


■ 77-/ 






58 


,13 . 


. 87" 






75 


12 ■» 


- , 88 ■ ■ 


> 




63 


24 


76 ^ 






6a 


19 








64 


8 • 
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10 



42-70 
61-73 
30-86 
54-80 



53-71 
78-97 
50-89 



39-71 
44-78 
50-70 
56-66 
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The allocated i\istructional .hours for each child from Table 10 
and the overall percentage of engaged ^time from Table 12 together 
provide estimates' of the time allocated to reading instruction each 

week and the average, engaged time for dach child (Table^ 13). ^^.^ 

. *• . • > , 

On Xhe average, neai^y five^houfs a week, almost one hour a* day, 
was allocated to reading instruction. At Schools A76 and 507, both 
IGE/WDRSD schools and both members of T2, much more time was alio- 
cated, an estimated 7.8 and 7.5 hours a'wee^, respectively. Very 
little time was reported to be allocated to reading in members of PI:. 
School 451, 1.3 hours a week, and School 903, 2.4 hours a week. At 
School 493 tlte allocated time was fairly small, 3.5 hours a week. 

' Engaged time' is estimated to be 3.0 hours .a week on the average. 
The estimated engaged hours at Schools 476 and 507, 5.3 and 4.9 hours . 
a week,- respectively, are high- due to both the greater number of hours 
.allocated to reading at these schools and the higher thauaverage ' ^ 
percentage of engaged time. At School 410, the third member of ^T2 , 
allocated hours had been about average but the ^svery high percentage 
of engaged tjme, 89%, resulted in a higher than average estimate of 
engAged hours ^ach i^jeek. The consistently larger estimate of engaged y 
hour^^'eatr^i week for members of cluster group T2 results from different ^ 
time use practices. The pair of schools with vety low allocated 
hours. Schools 451 and 903, had only average percentages of engaged 
time and thus the lowest estimated engaged hours a week. 

( ■ ' ■ - \. ■■• 
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; -Table 13 

. Estimated HS'urs Allocated and Engaged for 
' ; " Each Child Each Week, Grade 5- . ^ 
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per Child 
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lGE/lJt)RSD . 












466 , • 
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non-IGE/WDRSD 
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Tl 
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4. '3 ' 
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• 2.4 


902 


P2 


110.7 


4.4 
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2.6 


901 ' * 


P2 


105.9 


4.2 
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2.6 . 


* 903 


PI 


■ 59.4 


2.4 


65 
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Mean 




96.2 


3.8 


60 . 


2.3 


Tl Mean 
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. 4.9 


56 


2.8 


T2 Mean 
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75 


4:2 
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45r,9. 
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P2 Mean 
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4. '3 


60 
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3.0 
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10 
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From Table 10. . ^ , ' / 



From Table 12. 
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Means^^^of Instruction 

• The IGE Instructional PrxDgramming Model provides for the use of 
a"*varl/sty of^roup sizes and bf instructional mat^t:;ials to meet children's 
IndlviduaJL Instructional needs. The WDRSD was developed to be donsistent 
with the- IGE philosophy. Thus, all schools were expected to use a variety 
of gr^u'i^izes and types of materials. Only the ski^l development aspect^ 
of readings instruction is included in th^ WBRSD^ with the developers 
expecting that a. total program would be worked out at the local ^ ^ 
le\^el (Otto & Askov, 1974). In the. WDRSD schools in which only fo'^al ^ 
skill^nstruction was logged and observed, t^pre is no information , 
about ihStructional time with a basal reader series or in language 
experience groups; in both of those instances,* data for the WDRSD 
schools would provide underestimates of the time students spent in 
small groups and^ in schools u^ing ajbas^^l reader pyt>gram^ under- 
estimates of the time that print 'materials .were used. Since student 
interactions should increase with increase^d use of small groups/^'^^- 
underestimates of the use of small groups will be accompanied 'by* 
underes'^'lmates of student interactions* 

Use of the three group sizes and the three primary types of • 
materials and incl'dence- of teacher and student interactions are 
summarized in'^Table 14 as percentages^ of availably time.* ,None 
of the label groups drj cluster groups were cons'^^stent in any bf <^the 
three ins tract ional., process "^variables. For example, ^ the nqn-IGE/WDRSD 
schools were similar -ipl the proportion of individual work and vai^ied 
in the use of small groups; at the two schools in PI nearly the same 
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. . Table lA 

■■■ ' ' \ . ' 

InstructioTial Process Variables. .as a Percentage of Available Time, Grade 5 

\ ■ " . . . \ . ( 
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0 


•17 ^• 


26 . . 


13 




91 


13 


25 


88 


0 


38 


21 


6 


Tl 


48 


^ 1 


•50 . 




' ' 7 


1^ 
17 


25 t 
36 ^ 


6 "> 


P2 


' . -48-^ 


5 


47 


66 


13 . 


16 


P2 


50 ■ 


lb 


41 


69 


' 3 


41 


23 


11' 


PI 


• " 45 


. 12 


44 


72 


7 




27 


15 




48 


7. 


46 ' 


71 


10 ■ 


21 


29 


12 . 




57 


> 4 


/ 39 . 


' 83. 


., \ 4 


22 


22 


• 5 




57 




28 


. 81 


' 3 


46 


^'32 


. 6 




49 




45 


81 


5 


14 


26 


' 11 .. 




49 


8 


44 ' 


68 ; 


8 


\ 29 


• 30 •• 


14 



viatio: 



lorts^' 



53 
15 



39 
18 



80 
10 



28 
19 



27 
10 



12i 



ay not sum to 100 due to rounding, 
eed not sum to 100. 
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proportion of time was observed »for large groups but' t he schools used 
small groups and individual work in different propor^Jons, 

In use of materials, the non-IGE schools used ^iap'/r and pencil 

■ ' " -^ ■ 'r ■ • 

materials for a smaller proportion of time than m6st IGE scnpols; 
School 476 was like the non'-IGE schools^ Manipulatives were not^used 
at rhe non-WDRSD schools or at School 476;' percentage of T^.se varied 
among the WDRSD schools, ■ ' i ' ' 

" Teacher interactions were observed more frequently than student 
interactions at all schools, particularly at Schopls 476 and 410, where 
teacher interactions occurred at ten 'times the proportion- of student 

- i . . 

interaction. On the average, interactions were observed over one- 
third of the time, with no clear pattern for label groups or cluster 
groups, ' 
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Y All general objectives and aggregate objectives wera identified in 
Table 2. They are listed in Table 15 along with the number of items 
contributing to the score for each general objective and aggregate. 
Scores are reported as proportions of actual numbe^ of correct res^ionses 
to possible jiumber of correct responses. For aggregate objectives, 
scores are weighted averages of the scores for contributing objectives; 
for example, the score for Comprehension (15) at Gr-a^^ 2 is the sym of 
.25 of the score for Sentence Meaning Skills (10) and .75 of the score 
for Passage Meaning Skills (11). 

Achievement Gains: Real and Relative ' 

The distinction between actual changes in achievement between time 1 
and time 8 ^and the amount of change at one school compared to the amount 
of change a^ all schools is important for interpretation of the results 
in this chapterafid those that follow. The expected change, of course, 
is an increase during the school year from time 1 to time 8, an actual 
gain in achievement. if scores for all schools were identical at ti\ ^ 1 
and time 8, or if scores for all ;hools at time 8 were, say, half again 
as large as they had been at time 1, there would be no difference 
in the relative change in achievement. S.ince scores differed at time 1 
and at time 8 and since the proportion of change was different among . 

t 

schools, the relative change in achievement differs among schools. 
Relative change is expressed as residualized mean gain -ores, or 
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Talkie 15 

- Number of Items Contributing to Achievement 
Scores for the. IGE/WDRSD Comparative Study 





• . / 


Number of 


Items 


v 


General Objective / 


Grade 2 


prade 5 




V ■ ^ 






01 


Phonic Analysis — Consonants 


6 




02 


Phonic Analysis — Vowels . 


18 




03 


Phonic Analysis — Silent Letters 


3 


3 


04 


Structural Analysis 


15 


6 


05 


Vocabulary Meaning 


6 






WUECl rlLUaCK. 


HO 




06 


1 

Map Skills 


9 


15 


07 


Graph and Table Skills 
Reference Skills 


6 


11 


08 


3 


24- 


14 


SlHidy Skills 


18 


50 


09 


Word Meaning Skills 




6 


10 


Sentence Meaning Skills 


• 3 


3 


11 


Passage Meaning Skills . 




10 


15 


Comprehension 

<? ^ 


.. 12 


19 
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residuals; these sc'ores are both positive and negative even when ^ 
actual achievement increased for all schools. 

Since the intent of tbis study was to identify relatively more 
effective instructional processes, ' the discussion in this chapter and 
the- analyses in the next chapters use resiclualized mean gain scores. 
Negative residuals nearly always indicate relatively less effective 
instruction, a smrll positive change, rather than ineffective instruction, 
a negative change. 

Grade 2 results from Phonic Analysis — Vowels (02) apid Vocabvxl^:^.r,y 
Meaning (05) illustrate the difference between achievement gains anri 
residual gains. In Figure 5, scores for vowels increased with changes 
ranging frpm +.03 to +.18. The change of +.03 at School 901 brought 
scores from above the average at time 1 to average at time 8. At 
School 493 scores increased ,18 from just below average at time 1 to 



well above average at time 8. The dashed line indicates the*time 8 



o ^ 

scores that would Be predicted for these schools if change at all 

V 

schools bad occurred at the 8ame rate. The mark for*^Si^hool 901 is 
below the line; the residual for that school is -.04. i A score of ( 
.80 was predicted for School 901. For School 493, the mark is above 
the dotted line and the residual is +.09; the predicted score for 
School 493 is .75. 

♦ 

Figure 6 includes the same kind of information for Vocabulary' 
Meaning. The average increase is more than double the increase for 
Vowels and the greatest positive change occurred in schools -with low 
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Time 8 
scores 





.'40 .60 
Time 1 score >, 
Figure 5. Achievement on vowels at times 1 and 8. 



Time 8 
scores 



1.28 




.40' .60 

Time 1 score 



80 



1.00 



Figure 6. Achievement on vocabulary meaning ki; times 1 and 8. 

:. .. ■ . ' V 



School 


1 


466 


.62 


451 


.67 


476 


.76 


507 


.67 


372 


.62 


410 


.60 


493 


.66 


900 


.69 


902 


.74 


901 


.73 


903 J . 


.69 


Average 


.67 



School 

466 ■ 
451 
476 
507 
372 
410 
493 
900 
90 'J 
901 , 
903 
Average 



.56 

.49 

.49 

.40 

.45 

.50 

.39 

.50. 

,38 

,53 

,45 

,47 
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scores at time 1. Schools 451 and 507 both have residuals of +.09. 
At the former, scores were above average at time 1 and increased by .25. 
Scores at the'^^atter were well below average at time 1 and increased by 



493 and 9X)2 incre 



.42. Schools 493 and yD2 increased mope than average but still had 
small negative residuals due to tl^eir low scores at time 1. In contrast, 
Schopls 410 and 901 have small positive residuals with, less than average 
increases because their time/ scores were above average. /• 

Oh Vocabul-ary Meaning, scores at School 466 actually decreased, 
yielding a residual of -.07. Although the refatibnship among time use, 
'instructional process, and change in achievement is the topic of 

Y 

Chapters VII ^[jLJZIII, an additional caution in interpreting negative 
residuals is needed here. At School 466, no time had been allocated 

to objective 05 (Table 5), so no jconclusipn may be drawn about the 

A' 

effectiveness of instruction on Vocabulary Meaning. , 

■ ■ ■' . . ' -J 

Grade 2 

Results are shown in Table 16 which includes, for each x)bjective, 
scores at times 1 and' 8, change, and residual gain sco're. Mean scores 
are reported for^ label groups, for cluster groups, and for all schools 
combined. Test results at all eight test times are provided by Nerenz • 
(P.P. 80-10, 1980). 

Average scores increased for all objectives from time 1 .to time 8. 
At both test times 1 and 8, average scores were high for Sentence - 
Meaning Skills (10); averages" for Graph and Table Skills (07) were 
consistently low. \The smallest average gain, .05, was on Sentence 
Meaning, due at least in part to the very high scores at time 1 and the 
perfect or near-perfect scores at time 8. The greatest increase in 
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Table 16 

.Achievement Results for the Grade 2 Schools 



:hool 







Phonic Analysis- 


Phonic Analysis- 


Plionic Analysis- 








Consonants 


Vowels 


Silent Letters 


Structural Analysis . 


Vocabulary Meaning 




01 


, 02 


03 


0^ 


05 




Resid- 


Resid- 


^ ■ ■ Res id- 


Res id- 


Kesid- 


Cluster 


1 . 8 Change ual 


1 8 Change ual 


1 8 ' Change ual . 


1 8 Change oal^^ 


1 8 Change ual 



;e/wdrsd 

451 
476 

507 
Mean 

lE/non-WDRSD 
372 
410 
493 
Mean 

in-ICE/WDR?D 

900 ■ 

902 

901 

903 

Mean 

. Mean 
: Mean 

Mean 

Mean 

and Mean 

andard 

deviation 



Tl 


.63 


.78 


+.15 


-.02. 


.62 


.69 


,+.07 


-.03 


.17 


.48 


+.31 


-.07 


.55 


.61 


+.06 


-.10 


.56 


.52 


-.04 


-.07 


.PI 
't2 


.65 


.88 


+.23 


+.07 


-.67 


.72 


+.05 


-.04* 


.36 


.53 


+.17 


-.09 


.46 


.66' 


+:20 


-.00 


.49 


.74 


+.25 


+.09 


.62 


.80 


+.18 


-.00 


.76 


.84 


+.08 


+.01 


.79 


.69 


-.10 


-.10 


.62 


.73 


+.09 


-.02 


.49 


.75 


+.26 


+.10 


T2 


.74 


.70 ' 


-.04 


-.12 


.67 


.73 


+»06 




.50 


.72 


+.22 


+ .04 


.58 


.75 


+.17 


+.02 


.40 


.82 


+.42 


+.09 




.66 


.79 


+.13 




.68 


.74 


+.06 




.^6 


.60 


+.14 




.55 


.69 


+.13 




.48 


.71 


+ .23 



Tl 


.67 


.81 


+ .14 


+.00 


.62 


.70 


+.08 


-.02 


.26 


.47 


+.21 


-.11 


.42 


.68 


+.26 


+.04 


.45 


.52> 


+.07 


-.16 


T2 


.77 


.82 


+.05 


-.01 


.60 


.76 


+.16 


+.05 


.31 




+.28 


-.01 


.54 


.68 


+ .14 


-.03 


.50 


.67 


+.17 


+.03 - 




.73 


.85 


+.12 


+ .03 


.66 


.84 


+ .18 


+.09 


.48 


.82 


+.34 


+.15 


.48 


.70 


+ .22 


+ .03 


.39 


. .73 


+ .3^ 


-.00 




.72 


.83 


+.09 




.63 


.77 


+.14 




.35 


.63 


+.28 




.48 


.69 


+ .21 




.45 


.64 


+.19 



Tl 


^ .76 


.77 


+.01 


-.05 


.69 


.75 


+.06 


-.03 


.52 


.60 


*+.08 


-.09 


.52 


.74 


+ .22 


+.05 


.50 


.63 


+.13 


-.01 


P2 


.83 


.91 


+.08 


+ .07 


.74 


.86 


' +.12 


+.05 


.40 


.86 


+.46 


+ .22 


/.63 


.81 


+ .18 


+.06 


.38 


.71 


+.33 


-.03 


P2 


.91 


.85 


'-.06 


+.00 


.73 


.76 


+ .03 


-.04 


.39 


.68 


+.29 


+ .05 


.73 


.71 


-.02 


+.01 


.53 


.63 


+.10 


+ .02 


PI 


.68 


.83 


+.15 


+.02 


.60 


.71 


+.11 


+.00 


.23 


.58 


+.35 


+.01 


.50 


.63 


+.13 


-.05 


.45 


.63 


+.18 


-.05 




, .80' 


-.84 


'+.04 




.68 


.77 


+.08 




.38 


.68 


+.30 




.54 


.72 


+.18 




.46 


.65 


+.19 






^ .69 


.7\ 


+.10 




.64 


.71 


+.07 




.32 


.52 


+.20 




.50 


.68 


+.18 




.50 


.56 


+.06 






*'^>:71 


.n\ 


+.06 




.68 


.78 


+.10 




■ .53 


.67 


+.14 




.58 


.72 


+.14 




.56 


.75 


+.29 






;67 


.86 


V +.19 




.64 


.72 


+.08 




.30 


.56 


+.26 




.48 


.65 


+.17 




.47 


.69 


+ .22- 






.87 


.88 


^1 




.74 


.81 


+ .07 , 




.40 


.77 


+.37 




.68 


.76 


+.08 




.46 


.67 


+ .21 






.73 


.82 


+.09 




.67 


.76 


+.09 




.40 


.64 


■^24 




.54 


.70 


+ .16 




.47 


.67 


+.20 






.09 


.06 






.06 


.06 






.17 


.13 






.09 


.06 






-.06 


.09 
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Table 16 "(continued) 



BRSD 



.51 


+ .03 


-.17 


.50 


.57 


+.07 


-.07 


.63 


+.25 


-.03 




.74 


+.?5 


+.11 


.72 


+.25 


+ .05 


.61 


.67 


+.06 


-.Off 


.82 


+.U 


+.16 


.51 


.72 ■ 


+.21 


+.08 


.67 


+ .2^ 




.53 


.60 


+.15 



Word Attack Aggregate Hap Ski 11 b Graph and Table Skills' Reference Skills . ' Study Skills- Aggregate 

„ - ' ■ 07 . • 08 ; . u 

Resid- Resid- ^ Res^d- d *j 

-il::!^!! ' ' ^^-"^^ ' J'C^^HBe ual 1 8 Change ual 1 8 Change ual i g change u !l 

Tl .56 .64 +.08 -.06 ..62 .69 +.07 -.03 .33 .42 +.09 ,-.08 48 

■^ilJ '^^ •'^•01 -85 +.28- +.16. .44 .63 +.19 +.06 38 

T2 .67 .78 +.11 -.02 .74 .74' .00 -.06 .49 .55 +.06 -.05 .47 

J2 .61 .74 +.13 -.01 .64 .76 +.12 . +.03 .38 .62 +.24 +.09 39 

.60 . 72 +.12 . 64 . 76 +.12 . .41 .56 +.15 ^ ;"43 

*T1 . .-5? .67 

T2 .57 .72 

.57 .78 

.55 .72 

Tl * .61 .73 

P2 .65 .83 

P2 .64 .74 

PI .54 .68 

.61 .75 

.56 .68 

.62 .75 

.55 .70 

.65 .79 

.59 .73 

.05 .05 



+.15 


+ .00 


.62 


.68 


+.06 


-.04 


.30 


.■4.7 


+ .17 


-.01 


+.15 


+.01 


.51 


.64 


+.13 


-.00 


.41 


.54 


+ .13 


-.01 


+.21 


+.07 


.54 


.57 


+.03 


-.09 


.25 


.48 


+ .23 


+.02 


+.17 




.56 _ 


.63 


+.07 




.32 


.50 


^.18 




+.12 


-.02 


.56 


.68 


+.12 


+.00 


.52 


.68 


+.16 


,+.02 


+.18 


+.05 


.73 


.81 


+.08 


+.01 


.40 


.53 




-.01 


+.10 


-.03 


.81 


.88 


+.07 


+.03 


;5'6 


.58 


\02 


-.06 


+.14 


-.01 


. .48 


.62 


+.14 


-.00 


.30 


.47 


+ .17 


-.01 


+.14 




.64 


.75 


+.11 




.44 


.56 


+ .12 




+.12 




.60 


.68 


+ .08 ^ 




.38 


.52 


+ .14 




+.13 




.63 


.71 


+.08 




.40 


.57 


+ .17' 




+.15 




.53 


.74 


+.21 




.37 


.55 


+ .18 




+.14 




.77 


.85 


+.08 




.48 


.56 


+ .08 




+.14 




.62 


.72 


+.10 ^ 




.40 


.54 


+.14 








.10 


.10 






.10 


.08 







.35 


.62 


+.27 


-.03 


.47^ 


.60 


+.13 


-.02 


.75 


.88 


+.13 


+.16 


.52 


.65 


+.13 


+.00 


.60 


.68 


+ .08 


-.02 


.45 


.56 


+.11 


-.04 


.57 


.73 


+.16 




.48 


.60 


+.12 



.65 


.72 


+.07 


+.i2 


.56 


,69 


+.13 


+.01 


.47 


.75 


+.28 


+ .08 


.58 


,71 


+.13 ^ 


+.02 


.47 


.65 


+U8 


-.02 


.67 


.74 


+.07 


-.01 


.67 


.53 


-.14 


"-.18 


.45 


.56 


+.11 . 


-.04 


.56 


.66- 


+ .10' 




.57 


M 


+.11 


.'49' 


-.'62 


'+;13 




".51 


.62 


+,11 




.54 


.81 


+ .27 




.55 


.68 


+.13 




.53 


.58 


+ .05 




.47' 


.65 


+.18 




.47 


.70 


+.23 




.63 


.73 


+.10 




.52 


.68 


+.16 




.53 


.66 


+.13 




.13 


.11 






.07- 


.07 
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Table 16 (continued) 



Sentence Meaning Skills 
10 



School 


Cluster 


1 


8 


Change 




1 


8 


IGE/WDRSD 
















A66 


Tl 


.88 


.85 


-.03 


-.08 


-el 


.78 


451 


pr 


.77 


'.95 


+.18 


+ .07 


.90 


476 


T2^ 


.76 


.81 


.+.05 


-.06 


.67 


.81 


507 


T2 


.92 


.98 


+ .06 


+ .03 


.66 


.76 


Mean 




..83 


.90 


+.07 




.67 


.81 


IGE/hon-WDRSD 
















372 


Tl 


.96 


.07 


+ .01 


-.00 


.62 


.79 


• 410 


T2 


.88 


1.00 


+ .12 


+.07 


.74 


.78 


493 




.88 


1.00 


+.12 


+ .0^7 


.65 


.74 


Mean 




.91 


.99 


+.08 




.67 


.77 


non-IGE/WDRSD 




\ 












900 






.90 


+.01 


-.04 


.61 


.80 


902 • 


P2 


.94 




+.03 


+.01 


.59 


.80 


901 




.89 


.89 


+.00 


-.05 


.63 


.76 


903 


^^-■^ 


.91 


.95 


+. 04 


* +.00 


.72 


.71 


Mean 




.91 


.93 


+.02 




.64 


.77 


Tl Mean 




.91 


.91 


.00 




.63 


.79 


T2 Mean 




.85 


.93 


+.08 




.69 


.78 


PI M^an 




.84 


.95 


+.11 




.70 


.81 


P2 Mean 




.92 


.9 3 


+.01 




.61 


.78 


Grand Mean 




.88 


.93 


+.05, 




.66 


.78 


Standard 




.06 


.06^^ 






.05 


.05 



Passage Meaning Skills 
11 

Residr 



Comprehension Aggregate 



15 



+ .12 
+ .22 
+ .14 
+ .10 
+.14 



+ .17 
+ .04 
+.09 
+ .10 



+.21 

+ .13 

+ .16 
+.09 
+.11 
+.17 



+ .12 



Resid- 



deviation 



ual 


1 


8- 


Change 


ual 


-.00 


'.78 


.80 


\ 

+.02 


^2 


+.12 


.70 


.91 


+ .21 




+.03 


.69 


.81 


+.12 


-.02 


-.02 


.73 


.^2 


'+.09 


+ .00 




.73 


.84 


+.11 




-.00 


.71 


.84 


+.13 


+ .01 


+ .01 


.78 


.84 


+.06 


+ .04 


-.05 


.71 


.81 


+.10 


-.02 




.73 


.83 


>;K10^ 










1 




+ .01 




.83 


+ .15 


-.00 


+.01 


.68 


.84 


+.16 


+.01 


-.03 


.70 


.79 


+ .09 


-.04 


-.06 


.77 


.77 


.00 


-.04 




.71 


.81 


+ .10 






.,72 


.82 


+.10 






.73 


.82 


+.09 






.74 


.84 


+.10 






.69 


.82 


+.13 






.72 


.82 


+.10 






.04 


.04 
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average scores, .24, i^pa- on Silent Letters (03), one of the objectives 
on which time^ 1 scores were low. ' 

In general, there was little variance in scor.es at time 1 and the same 
or less at time 8. Variance increased slightly on Vocabulary Meaning. 

To simplify comparisons of the groups^ of schools, only the aggregate 
objectives Word Attack (13), Stufly Skills (14), and Comprehension (15) 
will be discussed. The lack of constant cLear-cut distinctions among- ^ 
label groups and among cluster groups that emerges in the aggregates 
also appears in the scores mTSs. general objectives. In Word Attack and 
Comprehension, there was very little-difference among the three label 
groups and overlap in the scores of schools in the groups; the overlap 
also occurred in Study Skills, but the IGE/non-\TORSn schools averaged 
lower than the two WDRSD groups at both times 1 and 8, Overlap of the 
ranees of the cluster groups is also typical, although their average 
scores d it fared r: r '■han ^'he label group av^ifages. At test time 1 
and time 8, ^he p: ' :: f non-IGE/WDRSD schools, P2, scored highest on 
both Word A,tta):k and Study Skills and tt^e triplet of Schoqls 476, 507, 
^ and 410, T2, had the second highest avet^age . On Comprehension, P2 J 
was lowest at time 1 and had the same average score as the two triplets • 
at time 8: The most extreme instance of score overlap occurred for 
Comprehension at time 8; Pi's highest average for cluster groups was 
composed of School 451's score of .91, highest of the 11 schools,' and 
School 903 's score of .77, lowest in the set. 

For, the aggregate o^^objectives. Schools 451, 410, and 902 had 
consistently positive residuals and Schools 4616, 476, 901, and 903, ' 
consistently negative. School 493 had the highest positive residual . 
for Word Attack; for both Study. Skills • and Comprehension, Scjiool 451 . 
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had the highest. School A66 had the lowest negative residual for both 
Word Attack and Study Skills; Schools ^01 and 9U3 had equally low • 
Comprehension residuals. . . 

Grade 5 \ 

Results are shown Iti Table 17 which includes^, for each objective, 

score.s at times 1 and 8, change, ^nd residual gain score. Average 

scores are reported for lab^i^roups, for cluster groups, and for all 

schools combined. Results of testing at all eight times are reported by 

Nerenz (P.P. 80-10, 1980). ' 

For most o.bjectives, average scores were at a moderately high 

level at tlSne^, .50^.60, with little variance. Average scores for all 

objectives increased from time 1 to time 8, with little or no change 
% 

in variance. The greatest: variability in scores was on Silent Letters 
(03) which had the. smallest average gain, .03. The largest average 
gain, .11, was on Word Meaning (09), increasing scores from .64 to 
.75. Only on Sentence Meaning (3,0) wds the average score at time 8 
higher. 

The group of non-lGE/WDRSD schools showed more positive average 
change on all three... aggregate objectives than either of the groups of 
IGE schools. IGE/WDRSD schools had higher positive gains than iGE/non- 
WDRSD schools on both Word Attack and Study Skills. The ayerage 
differences ^are slight; score ranges for all nhree groups overlap 
considerably on both Word Attack and Compteheri^sion. 



\ 

appears 



One difference among cluster groups appears to be consistent for 
the aggregate objectives: Average s<:ores for P2 were higher than average 
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Table 17 

Aclilevemcnt Reaults for the Grade 5 Schools 







Phonic Analysis — 










Silent Letters 


Structural Analysts A 


Word Attack Aggregate 






03 


04 


13 






Reald- 


Resld- 


Resld- 


jchool 


Cluster 


1 8 Change ual 


1 8 Change ual 


1 8 Change ual. 



IGE/WDRSD 


'.'I 


























466 


Tl 


.52 


.49 


-.03 


-.06 


.62 


.58 


-.04 


-.08 


.59 


.55 


-.04 


-.08 


451 


PI 


.44 


,83 


+ .39 


+ .34 


.50 


.64 


+ .14 


+ .00 , 


.48 


.70 


+ . 22 


+ .11 


476 


T2 


.49 


,51 


+ .04 


-.02 


,67 


.63 


-,04 


-.04 


.61 


.59 


-'.02 


-.04 


507 


T2 * 


.64 


.60 


-.04 


-.04 


.59 


,60 


+ .01 


-.06 


.61 


.60 


-.01 


-.03 


Mean 




.^.52 


.61 


+ .09 




.60 


.61 


+.01 




.57 


.61 


+ .04 




IGE/non-WDRsb 


















« 










372 


Tl 


.32 


.19 


-.13 


-.21 


..54 


.60 


+ .06 


-.05 


.47 


.46 


-.01 


-.13 


410 


T2 


.25 


.31 


+ .06 


- +,12 


.55 ' 


.70 


+ .15 


+ .05 


.45 


.57 


+ ,12' 


-.01 


493 




. 75 


,55 


-.20 


-.13 


,7,1 


,69 


-.02 


+ .01 


.72 


.64 


-.08 


-.^03 


Mean 




.44 


.35 


-.09 




.60 


.66 


' +.06 




.55 


.56 


+ .01 




non-lGE/WDRSD 




















i 








900 


Tl 


.54 


.49 


-6^05 


-.08 


.62 


,73 


+ .11 


+ .07 


.59 


.65 


+ .06 


+ .02 


902 


P2 


.60 


.83 


+ .23 


+.22 


.58 


,78 


+ .20 


+ .13 


.59 


.80 


+ .21 


+ .17 


901 


P2 


,58 


,77 


+ .19 


+.17 


.53 


.58 


+ .05 


-.06 


.55 


.64 


+ .09 


+ .03 


903 


PI 


.56 


,46 


-.10 


-,12 


.60 


.70 


+ ,10 


+ .04 


•V 


.62 


+ .03 


-.01 


Mean ^ 




.57 


.64 

t 


+ .07 




,58 


.70 


+ .12 




.58 


.68 


+ .10 




Tl Mean 




,46 


.39 


-.07 




.59 


,64 


+ .05 




.55 


.55 


.00 




T2 Mean 




.46 


.47 


+ .01 




.60 


.64 


+,04 




.56 


.59 


+ .03 




PI Mean . 




.50 


.65 


+ .15 




.55 


.67 


+ . 12 




.54 


.66 


+ .12 




P2 Mean 




.59 


,80 


+ .21 




.56 


.68 


+ .12 




.57 


.72 


+ .15 




Grand Mean 




.52 


,55 


+ .03 




.59 


.66 


+ .07 




.57 


.62 


+ .05 




Standard 




.14 


.20 






,06 


.07 






.08 


.09 







deviation 
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Table 17 (continued) 



Map Skills 
06 



Graph and Table Skills 
07 



Reference Skills 
08 



Skills Aggregate 



SchooJ.^^ 


^JSs% Cluster 


1 


8 


Change 


Res id-, 
ual 


■ 1 


a' 


Ch£ 


inge . 


Resid- 
ual 


1 


8 


Change 


Resid- 
ual 


1 


8 


Change 


Resid- 
ual 


IGE/WDRSD . 


^-^^ 








-.02 






























Tl 


.48 




+.11 


.49 


.61 


+ . 


12 


-.00 


.38 


-.43 


+ .05 


-.04 


.43 


.52 


+ .09 


-.01 


kJl 


PI 


.66 


.69 


+.03 


-.02 


'.65 


.65 




00 


-.05 


.49 


.51 


+ .02 


-.06 . 


.58 


.59 


+ .01 


-.06 


476 


T2 


.50 


.65 


+.15 


+ .02 


.61 


.66 


+ . 


05 


-.02 


.43 


.53 


+ .10 


+ .02 


.49 


.59 


+ .10 , 


+.01 


507 


T2 


.70 


.72 


+.02 


-.01 


.76 


.78 


+. 


02 


+ .02 


.46 


.60 


+ .14 


+.06 


' .60 


.68 


+.08 


+ .02 


Mean 




.59 


.66 


+.07 




.63 


.68 


+ . 


05 




.44 


.52 


+ .08 




.53 


.60 


+ .07 





IGE/non-WDRSD 



372 


Tl 


.50 


.54 


+.04 


-.09 


.51 


.57 


+ .06 


• -.05 


.34 


.35 


+ .01 


-.08 


.43 


.46 


+ ."03 




410^ 


T2 


.59 


.69 


+.10 


+ .02 


. .71 


.67 


-.04 


' -.06 


.44 


.41 


-.03 


-.11 


.54 


,55 


+ .01 




493 




.61 


.77 


+.16 


+ . 08 


.68 


.74 


+.06 


+ .02 


.51 


.56 


+ .05 


-.02 


.58 


.66 


+.08- 


+ 


Mean 




..57 


.67' 


+.10 




.63 


.66 


+ .03 




.43 


.44 


+.01 




.52 


.56 


+ .04 




npn-IGE/WDRSD 




































900 


Tl 


-59 


.67 


+.08 


-.00 


.68 


.71 


+.03 


-.01 


.43 


.65 


+.22 


+ .14 


.53 


.67 


+ .14 


+ 


902 


P2 


.62 


.69 


+ .07 


-.00 


.63 


.78 


+.15 


+ .09 


.43 


.60 


+ .17 


+ .09 


.53 


.67 


+ .14 


+ 


901 


.P2 


.43 


.63 


+.20 


+ .04 


.54 


.62 


+.08 


-.02 


.30 


.44 


+.14 


+.04 


.39 


.54 


+.15 


+ 


903 


PI 


.59 


.66 


+.07 


-.01 


.54 


.71 


+.17 


+ .07 


.40 


.46 


+ .06 


-.03 


.49 


.58 


+ .09 


+ 


Mean 




.56 


.66 


+.10 ' 




.60 


.71 


+.11 




.39 


.54 


+ .15 




.49 


.62 


+ .4-3 




Tl Mean 




.52 


.60 


+.08 




.56 


.63 


+.07. 




.38 


.48 


+ .10 




.46 


.55 


+ .09 




T2 Mean 




.60 


.69 


+.09 




.69 


.70 


+.01 




.44 


.51 


+ .07 




.54 


.61 


+ .07 




PI Mean 




o .63 


.68 


+.05 




.60 


.68 


+ .08 




.45 


.47 


+.02 




.54 


.59* 


#-.05 




P2 Mean 




.53 


.66 


+.13 




.68 


.70 


+.02 




.37 


.52 


+ .15 




.46 


.61 


+ .15 




Grand Mean 




.57 


.66 


+.09 




.62 


.68 


. +^08 




.42 


.50 


+.08 




.51 


.59 


+ .08 




Standard 




.03 


.06 






.09 


.07 






.06 


.09 






.07 


,07 







deviation 
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Table 17 (continued) 



School 



Cluster 



V'^rd Meaning Skills 
09 

Res id - 
1 8 Change ual 



Sentence Meaning Skills 
10 

Resid- 
1 8 Change ual 



Passage Meaning Sfkills 
11 

Resid- 
1 8 Change ua^ 



Comprehensloa- Ap.gregate 

1 r. 



1 



ual 



ICE/WDRSD 
A66 
451 
A76 
507 
Mean 

ICE/non-WDRSD 
372 
410 
493 . , 
Mean 

non-IGE/WDRSD 
900 
902 
901 \ 
903 ' 
Mean 

Tl Mean 
yl Mean 
PI Mean 
P2 Mean 

Grand Mean 
Standard 
deviation 



Tl 
PI 
T2 
T2 



Tl 



Tl 
P2 
P2 
PI 



59 


.59 


.00 


-.14 


. 77 


.74 


-.0 3 


-.00 


.62 


.64 


+ .02 


-.05 

-.oi\ 


68 


.75 


+ .07 


-.01 


.84 


.56 


-.28 


-.16 


.65 


.70 


+ .05 • 


69 


.76 


+ .07 


-.01 


.74 


.78 


+ .04' 


+ .03 


.65 


.68 


+ .03 


-.03\ 
+.00 \ 


64 


.82 


+ .18 


+ .07 


.67 


.86 


+ .19 


+ .09 


.68 


.73 


+ .05 


65 


.73 


+.08 




.76 


.74 


-.02 




*65 


.69 


+ .04 



.63 
.69 
.68 
.67 
.67 



.64 
.69 
.72 
.78 
.71 



+.01 
. 00 
+.04 
+. 11 
+ .04 



-.07 
-.04 
-.01 
+ .06 



67 


.63 


-.04 


-.13 


. 73 


.65 


-.08 


-.10 




.54 


-.01 


-.10 


.62 


.59 


-.03 


-.11 


58 


.69 


+ .11 


-.04 


.46 


.86 


+.40 


+.02 


.5t* 


.74 


+ .20 


+.11 


.54 


.74' 


+.20 


+.07 


75 


.80 


+ .05 


+.02 


.86 


.86 


+ .00 


+ .15 


...66 


.73 


+ .07 


+.02 


.72 


.77 


+.05 


+.03 


67 


.71 


+.04 




.68 


.79 


+.11 




.58 


.67 


+ .09 




.63 


.70 


+.07 



.66 


.76 


+.10 


+ .00 


.62 


.78 


+.16 


-.01 


.63 


.68 


+ .05 


-.01 


.64 


.72 


+ .08 


+.01 


.62 


.80 


+.08 


+ .06 


.80 


.86 


+.06 


+.13 


.56 


.74 


+ .19 


+.09 


.62 


.78 


+.16 


+.08 


.47 


.77 1 


+ .30 


+ .07 


.70 


.68 


-.02 


-.08 


.45 


.53 


+.08 


-.04 


.50 


.63 


+.13 


-.02 


.70 


.88 


+.18 


+ .11 


.78 


.63 


-.10 


-.06 


.62 


.70 


+ .08 


+ .01 


.67 


.75 


+ .10 


+ .03 


.61 


.80 


+ .19 




.73 


.75 


+.02 




.57 


.66 


+ .09 




.61 


.72 


+ .11 


.64 


.66 


+.02 




.7X 


.72 


+.01 




-\ 60- 


XI 


+ .02 




.63 


.65 


+.02 




.68 


.76 


+.08 ' 




.62 


.83 


+ .21 




.62 


Jl 


+ .10 




.63 


.75 


+.12 




.69 


.82 


+.13 




.81 


.62 






.64 


.70 


+ .06 




.68 


.72 


.+.04 




.55 


.79 


+.24 




.75 


'.77 


+.02 




.51 


.64 


+ .13 




.56 


.71 


+ .15 




.64 


.75 


+ .11 




.72 


.76 


+.04 




.60 


.67 


+ .07 




.63 


.71 


+ .07 




.08 


.08 






.11 


.xO 






.07 


.08 






.07 


.06 
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for the other cluster groups and the lower score in the pjair was above 
the high score for other cluster groups in five of nine comparisons. 
Score ranges for the other three cluster groups overlapped for all three 
aggregates. Schools 902 and 901 which are in P2 are both non-tCE/WDRSD 
Sjchools. 

School 902 is the primary source of the differences noted in the 
preceding two paragraphs; residuals for that school were consistently 
high positive for the aggregate. Schools 466 and 372, IGE/WDRSD and 
IGE/non-VJDRSD, both members of cluster group Tl, had consistently 
negative residuals and, on both Word Attack and Comprehension, negative 
or low positive chafes. The differences that seem to exist 



among specific schools. The an=>lysis must be conducted on individual 
schools rather than g.oups. 



among gi;oups of schools can be a 




reme differences 
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In this chapter, results for each of thQ thr^e aggregate objectives 
are discussed. The intent was. to relate achievement to time and means of 
instruction, emphasizing instructional patterns that were particularly ef- 
fective in raising child^ren's achievement.' No such patterns bould-be-iden-- 
tified. The difficulty in identifying effective ins tructional "^patterns 
suggests **"that instruction was not well targeted; that is, instruction 
seems to have beei/ provided less on the basis of individual instructional 
needs than on the basis of skills customarily taught grade level. 

As noted previously, achievement was fairly high at time 1; only in 
Study Skills at both grades and in Word Attack at: Grade 5 were any initial 
scores below Standard deviations were small at both times 1 and 8 

indicating little overall difference among schools. Average gains from 
• time 1 to time 8 were, from .10 j;o .14 for Grade 2 and from .05 to .08 for 
Grade 5. 

GRADE 2 

The contrast between School 476 and School 493 for second-grade in- 
struction in Word Attack provides a striking example of this effect (see 
Table 18). School 476 had the highest score at time 1; all of the read- 
ing skill instruction time was allocated to Word Attack; the score at 
time 8 was above average but the score gain was less than average. School 
493 had a nearly average score at time 1; about cwo-thirds of the reading 
skill time was allocated to Word Attack; the score at time 8 was the same 
as that at School 476; the score gain aT^chool 493 was half again as 
high as the average. 
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Table 18 

Data Summary for Objective 13, Word Attack, Grade 2 



School 



Demog- Use of Use of 
raphy WDRSD IPH 



Est. 
hrs /wk 



Allocated Engaged 



Grouping 



Materials 



Interactions 



Achievement 



Hrs. 



Hrs. 



Indiv, Small 



Lg. 



P&P Manip . Print S tud . Tchr . 



Ch. Resid. 



IGE/ WDRSD - 



lon-IGE/l'DRSD 
900 
9G2 
901 

903 . 

lean 

Standard 
deviation 



2 
5 
6 
6 

4.2 
1.8 



466 


2 


4.50 


75 


.25 


4.9 


451 


4 


7.25 


94 


.75 


2.4 


476 


5 


6.75 


71 


00 


5.0 


507 


6 


6.25 


80 


75 


5.2 


3E/non-WDRSD 












372 


2 


00 


72 


,50 


5.7 


410 


4' 


00 


75. 


50 


2.0 


493 


•5 


00 


56. 


00 


2.5 



4.25 
7.75 
9.25 
4.00 

4.55 
3.31 



72.00 
69.25 
82.25 
82.50 

75.6 
9.8 



2.0 
4.8 
3.1 
1.4 

3.5 
1.6 



189.3 
67.4 
23.1 

188.5 



671.7 
94.5 
217.1 



65.3 
224.5 
235.9 

86.9 

187.7 
177.3 



71 


20.72 


67 


6.39 


11.47 


12.96 


16.25 


1,98 


■ 1.55 


2.57 


8.61 


.56 


.64 


+ .08 


-.06 


60 


21.49 


77 


6.98 


4.88 


15.98 


25.53 


1,21 


00 


4.15 


9.17 


.56 


...71 


+.15 


+.01 


100 


30.62 


74 


10.85 


00 . 


30,81 


22.35 


.47 


1.06 


4.29 


18.83 


. .67 


'.78 


+ .11 


-.02 


57 


33.51 


75 


18.44 


.30 


26.24 


30.91 


,35 


5,21 


3.87 


13.91 


,61 


,74 


+ .13 


-.01 


64 


59.93 


56 


65.04 


11.28 


31,18. 


80.75 


4,81 


16.30 


11.70 


17.28 


.52 


.67 


• 

+.15 


+.00 


60 


13.69 


82 


7.91 


8.87 


00 


14,17 


.47 


3.05 


1.17 


5.66 


.57 


.72 


+,15 


+.01 


64 


25.81 


85 


17.22 


.31 


12.76 


23,34 


00 


1,70 


1.87 


6.67 


.57 


.78 


+ .21 


+ .07 
































49 


14.37 


85 


4.45 


1.97 


10,49 


7,27 


2.98 


.12 


2.76 


3.91 


,63 


.73 


+ .12 


-.02 


61 


18.35 


85 


8.65 


.40 


12.55 


10.79 


6,04 


.45 


3,87 


8.37 




.83 


+ .18 


+'.05' 


39 


22.19 


65 


15.49 


6.41 


12.39 


25.97 


4,06 


5,76 


3.16 


6.29 


: 64 


.74 


+.10 


-.03 


57 


13.19 


56 


9.40 


2.29 


H.76 


19.59 


1.72 


.06 


2.34 


6.97 


,54 


.68 


+ .}4 


-.01 


62 


24.90. 


73 


15.53 


4.38 


16.10 


25.17 


2,19 


3.21 


3.80 


9.61 


.59 


.73 


+ .14 




15 


13.37 


11 


17.05 


4 .48 


9.51 


19.73 


2.03 


4.7r 


2.80 


4.90 


.05 


.05 


.04 





■ \ 



141 



ERIC 



115 

For Study Skills (Table 19), similar contrasts can be drawn between 
Schools 451 and 507 and Schools 900, 902, and 901, From time 1 to time 8, 
the gain at School 451 was nearly double the average; the time 8 score 
was ,74 as it was at School 901 where more time and a greater proportion 
of time had been allocated. The gain at School 507 was well above 

average although as at Schopl__451.,„ there. .was-- less- emphasis - on study 

skills in the overall reading 'skills program than at Schools 900, 902, and 
901. There is no clear difference in the instructional patterns at School 
507 and at Schools 900, 902, and 901/ ' ■ 

For Comprehension Skills (Table 20) , achievement at time 8 was 
quite high at all schools and outstanding at School 451. Again, at this 
schogl, the emphasis on comprehension skill instruction was" no greater 
s than at most other schools and the instructional pattern did not differ 
from other less effective patterns, 
GRADE 5 

In all three skill areas, initial achievement was at a moderate 
level with little variation among schools; achievement at time 8 was 
not much higher and there still was little variation among schools. 

Large achievement gains in Word Attack skills (Table 21) occurred 
at two of the schools that allocated no time to formal skill instruction 
in Word 'Attack, Schools 451 and 902. Only skill instruction and not the 
total reading program was studied in these schools so loiowledge of the 
reasons for the improvement is not available. 

In Study Skills (Table 22) , above average achievement gains were 
made at Schools 900, 902, and 901. These gains were not extremely 
large and did not lead to impressively high achievement at time 8 . . No 
distinct instructional pattern was observed at these' three schools. 



Table 19 

Data Summary for Objective 14, Study Skills, Grade 2 

\ ■ 



Allocated Engaged 



Grouping 



Materials 



Interactions 



Achievement 



School 



Hrs. 



Hrs. 



Indlv. Small Lg. 



P&p Manlp. Print Stud. Tchr. 



IGE/WDRSD 

, .466 — 
451 
476 



- 0.0 
12.0 
0.0 



11 



507' 


58.3 


18 


1 8 . 16 


83 


12.96 


00 


9.00 


13.86 


00 


00 


2.20 


6.02 


IGE/nonWDRSD 






















.56 




372 


58.8 


6 


5.53 


77 


5.64 


1.18 


.38 


.86 


.14 


1.73 


1.39 


410 


5.0 


3 


. 1.86 


76 


1.98 . .. 


.47 


00 


2.28 


00 


1.03 


00 


.18 


493 


19.1 


6 


.67 


77 


.30 


00 


.57 


.42 


'oo 


.45 


00 


.37 


n on- IGE/WDRSD 






















.44 


7.24 


900 


68.9 


51 


11.60 


89 


4.78 


00 


8.24 


9.15 


00 


00 


902 


146.0 


39 


6.70 


86 


5.44 


00 


2.40 


6.05 


1.75 


00 


1.53 


2.11 


901 


203.4 


34 


3.93 


69 


3.41 


.15 


2.15 . 


5.43 


00 


.14 ' 


.61 


2;57 


903 


0.0 
























7 Schools 
























2.84 


Mean 


79.9 


22 


6.92 


80 


4.93 


.26 


3.25 


5.44 


.27 


.48 


.76 


Standard 


70.7 


19 


6.11 


7 


4.04 


.44 


3.78 


4.85 


.65 


.67 


.82 


2.75 


deviation 


























11 Schools 


























Mean 


42.9 


15 






















Standard 


59.5 


18 























1 


8 


Ch. 


Res 


-.50 


.57 


+ .07 




.49 


.74 


+.25 


+ , 


.61 


.67 


+ .06 




.51 


.72 


+ .21 


+, 


.47 


.60 


+ .13 




.52 


.65 


+ .13 


+ , 


.45 


.56 


+.11 




.56 


.69 


+ .13 


+, 


.58 


.71 


+ .13 


+ , 


.67 


.74 


+.07 




.45 


.56 


+ .U 





.54 
.07 



.53 
.07 



.67 
.07 



.66 
.07 



+ .13 
.04 



+ .13 
.06 



deviation 
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Table 20 

Data Summary for Objective 15, Comprehension, Graoe 2 



School 



Allocated Engaged 



Hrs. X 



Hrs. 



Grouping 



Indiv. Small 



Materials 



r.^teractions 



P&P Manip. Print Stud. I'chr. 



Achievement 



Ch. Resid. 



IGE/WDRSD 



A66 ' 


78.0 


29 


9.85 


67 


451 


32.4 


29 


5.61 


75 


4 76 


0.0 








507 


86.2 


26 


22.31 


71 


IGE/non-WDRSD 










372 


326.2 


31 


17.06 


73 


410 


58.6 


37 


34.92 


77 


493 


103.7 


31 


5.17 


79 


non- IGE/WDRSD 










900 


0.0 








902 


0.0 




o 




901 


158.0 


26 


10.28 


59 


903 


64.8 


43 


11.81 


72 


8 Schools 










Mean 


113.3 


32 


14.63 


72 


Standard 


93.6 


. 6 


9.98 


6 


deviation 










11 Schools 








V 


Mean 


82.5 


23 






Standard 


94.5 


15 







2.30 
2.29 

8.68 



14.15 
33.06 
4.34 



8.79 
5.27 



9.86 
Iff. 18 



.51 11.98 
00 5.19 



00 



4.71 
12.03 
.06 



2.81 
1.39 



2.69 
4.13 



22.70 



4.70 
00 
2.17 



5.83 
9.81 



7.81 


.71 


.24 


1.02 


S.57 


.72 


'.80 


+ .08 


-.02 


4.92 


1.07 


00 




2.30 


.70 


.91 


+ .21 


+ .08 












.69 


.81 


+ .12 


-.02 


17.86 


.76 


1.75 


'».3i 


10.37 


.73 


.82 


+ .09 


+.00 



19.41 
40.02 
6.34 



14.54 
12.08 



7.80 15.37 
7.14 11.27 



' .67 
00 
00 



.06 
1.59 



.61 
.57 



5.56 


3^01 


3.63 


.71 


.84 


+ .13 


+ .01 


29 .53 


«.08 


^^53 


.78 


.84 


+ .06 


+ .04 


oo 


.33 


.95 


.71 


.81 


+ .10 


-.02 



2.t/'v 
.09 



4.98 
10.10 



.42 
2.51 



2.09 
1.60 



2.19 
5.9.7 



4.56 
2.98 



.68 


.83 


+ .15 


-.00 


.68 


.84 


+ .16 


+.01 


.70 


.79 


+ .09 


-.04 


.77 


.77 


+.00 


-.04 


.73 


.82 


+ .10 




.03 


.04 


.06 





.72 
.04 



deviation 



.82 
.04 



+ .11 
.06 
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Table 21 

Data Summary for Objective 13, Word Attack, Grade 5 



r 

J 



Ichool 

J — - — 


Demog- 
raphy 


Use of 
WDRSD 


Use of 
IPM 


Est. 
hrs/wk 


Allocated 

y 


Engaged 


Grouping 






Materials 


Interactions 




Achievement 


Hrs. 


X 


Hrs . 


X 


Indiv. 


Small 




P&P 


Manip. 


Print 


Stud. 


Tchr. 


1 


8 


Ch. I 


;ge/wdrsd 








































466 


2 


4.50 


75.25 


2.4 


40.5 


43 


9.48 


76. 


5.09 


.51 


6.92 


10.57 


.00 


.42 


.85 


3.18 


.59 


.55 


-.04 


451 


4 


7.25 


94.75 


.8 


0 
























.48 


.70 


+.22 


476 


5 


6.75 


71.00 


5.3 


.8 


00 


.61 


87 


.27 


00 


.43 


.52 


.00 


00 


.16 


.21 


.61 


.59 


-.02 


507 


6 


6.25 


80.75 


4.9 


0 
























.61 


.60 


-.01 


;GE/non-WDRSD 








































372 


2 


0.00 


72.50 


3.7 


162.4 


28 


23.95 


86 


.21.38 


1.52 


5.02 


25.96 


.00 


9.11 


.96 


4.72 


.47 


.46 


-.01 


' 410 


4 


0.00 


75.50 


4.0 


, 99.9 


30 


3.55 


95 


1.77 


1.95 


00 


3.67 


.00 


^ 2.80 


.86 


.91 


.45 


.57 


+.12 


493 


5 


0.00 


56.00 


2.3 


55.9 


23 


1.17 


95 


00 . 


00 


1.23 


1.16 


.00 


00 


.30 


.82 


.72 


.64 


, -.08 


lon-IGE/WDRSD 








































900 


2 


4.25/ 


^tTToo 


2.4 


0 




2.84 


66 


1.13 


.09 


3.10 


1.93 


.00 


1.00 


.54 


1.38 


.59 


.6$ 


+.06 


902 


5 


7.75^ 


69.25 


2.6 


0 




.07 


100 


00 


00 


.07 


.07 


.00 


00 


00 


00 


.59 


^0 


+.21 


901 


6 


9.25 


82.25 


2.6 


70.2 


14 


3.15 


73 


2.66 


.10 


1.57 


2.95 


.00 


.59 


.35 


.58 


.55 


.64 


+.09 


^903 


6 


4.00 


82.50 


1.5 


4.0 


3 






















.59 


..62 


+.03 


-\ 

\ Schools 


.A 










X. 




























Mean 




. 4.06 


. 71.72 


3.2 


53.7 


17 


5.60 


• 85 


4.04 


.52 


2.28 


5.85 


.00 


1.74 


.50 


1.48 


.57 


.61 


+.04 


Standard 


1.6" 


3.73 


7.48- 


1.1 


57.3 


16 


7.97 


12 


7.21 


.78 


2.50 


8.78 


.00 


3.12 


.36 


1.64 


.08 


.10 


.10 


deviation 








































■1 Schools 








































Mean 


A. 2 


4.55 


75.6ri 


3.0 


39.4 


13 






















.57 


.62 


+.05 


Standard 


1.8 


3.31 


9.76 


1.4 


53.8 


16 






















.08 


.09 


.10 



deviation 



14 
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Table 22^ 



Data Summary for Objective lA, StudAskllls, Grade 5 



School 



Allocated Engaged 



Grouping 



Hrs. 



Hrs. ■ Z 



Material 



Infii 



V. Small Lg. 



-— IGE/WDRSD 

466 
451 
476 
507 

IGE/non-WDRSD 
372 
410 
493. 

non-IGE/WDRSD 
900 
902 

%3 

Mean 

Standard 
deviation 



. 14.2 
54.7 
78.3 

130.1 



64.6 
94.3 
73.6 



130.1 
18.8 

190.8 
73.6 

83.9 
51.4 



15 1;70 85 

61 17.31 74 

45 16.13 87 

51 24.20 78 



30 



51 24.54 71 

47 12.89 81 

39 24.95 76 

30 5.70 79. 



37 
16 



13.62 80 
8.38 6 



.32 
13.56 
6.97 
21.17 



.05 
1.11 

.66 
1.89 



1.62 
8.61 
11.01 
8.49 



19.06 
9.00 

14.68 
3.11 

9.51 
6.84 



« .47 
00 

3.16 
.29 

.93 
1.02 



14.95 
6.86 

14.98 
3.78 

7.03 
5.07 



1.93 
20.07 
12.91 
27.31 



8.65 


87 


9.02 


, .24 ,70 


9.78 


8.07 


88 


4.61 


/2.04 2.51 


7.88 


5.70 


79 


3.11 / 


' .29 3,78 


6.75 



29.11 
12.77 
21.55 
6.75 

14.23 
8.99 



Ijiteractions' 



Achievement 



00 
•1.23 

00 
4.56 



00 
00 
00 



3.12 
.72 

1.53 
00 

1.01 
1.54 



4.71 
1.91 
13.89 
1.07 

5.62 
5.39 



Pri^t 


Stud. 


Tchr. 


1 


8 


Ch'. 


Resid. 


- oq 


\ .24 


.90 


.43 


.52 


+.09 


-.01 


4.26 


\l.50 


4.60 


.58 


.59 


+.01 


-.05 


5.73 


\63 


9.67 


.49 


.59 


+.10 


+ .01 


17.10 


3.\34 - 


6.85 


,60 


.68 


+.08 


+ .01 


6.56 


■.36\ 


.76 


.43 


.46 


+.03 


-.01 


. 5.52 


1.'48 \ 


2.94 


.54 


.55 


+.01 


-.06 


1.07 


1.16 


1.28 


.58 


.66 


+.08 


+.01 



1.77 
2.98 
3.13 
1.16 

1.61 
1.10 



9.78 
4.93 
7.95 
1.28 

4.63 
3.50 



.53 
.53 
.39 
.58 

.51 
.07 



.67 +.14 

.67 +.14 

.54 +.15 

.66 +,08 



.59 
.07 



+.08 
.05 



+.06 
+.06 
+.04 
+.01 
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In Comprehension (Table 23) the achievement gain was dramatic at 

J 

School 410 and large at Schools 507, 902, and 901* A^. School 410, the. 
total reading period was logged and observed; perhaps the small groups 
were a particularly effective mechanism for improving comprehension skill 
at that school. Because only skills instruction was observed at other 
schools, where no instructional pattern emerged, we cannot draw any 
conclusions about the effectiveness of the basal reading groups in 
increasing achievement on specific comprehension skills. 




Table 23 

Data Summary for Objective 15, Comprehension, Grntle 5 



Allocated Engage^d^ 



Grouping 



Materials 



School 


Hrs. , 


X 


Hrs. 


X 


Indiv. 


Small 




P&P 


Manip. 


Print 


IGE/WDRSD 






















. 466 


39.0 


42 


10.37 


72 


6.39 


1.60 


6.47 


io.97- 


1.52 


.35 


451 


34.6 


39 


17.14 


f5 


10.4 7 


00 


12.26 


21.13 


,05 


3.20 


476 


94.0 


54 


14.18 


91 


4.34 


2.45 


8.«4 


10.26 


00 


4.66 


507 


123.8 


49 


18.82 


80 


20.56 


.16 


2.84 


21.56 


.08 


16.56' 


IGE/non-WDRSD 






















372 


361.9 


61 


36.05 


79 


38.13 


1.23 


6.36 


41.26 


00 


26.38 


410 


142.9 


42 


34.59 


94 


23.23 


-12.93 


.44 


29.97 


00 


14.16 


493 


116.5 


47 


12.62 


82 


'6.98 


.20 


8.26 


13.00 


00 


2.95 



non-IGE/WDRSD 
900 
902 
901 
903 

Mean 
Standard 
deviation 



123.8 


49 


1.92 


64 


00 


00 


3.00 


.96 


00 


00 


216.0 


53 


14.76 


88 


6.69 


1.58 


8.52 


8.61 


'3.42 


3.79 


226.0 


46 


18.00 


82 


12.03 


^ 2.37 


-7.44 


16.43 


00 


9.67 


117.7 


97 


30.42 


74 


18.43 


* 4.79 


17.91 


29.55 


3.00 


4.46 


145.1 


53 


18.99 


80 


13.39 


2.48 


7.49 


18.52 


.73 


7.83 


93.3 


16 


10.57 


9 


10.92 


3.75 


4.78 


11.63 


1.31 


8.15 



Interactions 



Achievement 



Ch. Resld. 



1.19 
1.19 
.81 

1^85 

5.6^ 
1.59 



.28 
2.35 
2.80 
6.28 



2.96, 
6.94 
Q.36 
4.95 



5.36 
7.65 
4.04 



22 
00 



.63 
.69 
.68 
.67 



.64 
.69 
.72 
.78 



.62 .59 
.54 .74 
.72 .77 



+.01 
.00 
+.04 
+.11 



-.03 
+.20 
+.05 



1.06- 


.64 


.72 


+ .08 


6.70 


.62 


.78 


+.16 


5.06 


.50 


.63 


+ .13 


11.10 


.67 


.75 


+.08 


5.83 


.63c 


.71 


-+.08 


2.74 


.07 


.06 


.07 



-.06 
-.04 
+.00 
+.05 



-.11 
+ .06 
+.02 



+.oa 

+.07 
-.02 . 
+.02 
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VIII V ' 

Summary 

.• 

The data presented in this report are from one of five studies conducted 
as a part of Phase IV or the IGE Evaluation Study. The four primary purposes 
of~tl>^e Phase IV Evaluation Project (page 8) reflect 'our attempt to describe 
in consl^derable detail the actual operating characteristics of a sample of 
schools that were using the curriculum materials designed to be compatible 
with IGE. This comparative study was designed to. provide information related 
to the fourth purpose which was, for the reading program Wisconsin Design 
for Reading Skill Development (WDRSD) ,• to contrast two situations: . 

— IGE schools using the prograi6 with non-IGE schools using the 
program . 

— IGE scljools using the program with IGE schools using alternate 

\ 

\ programs ^ - 

The contrast was made on the variables of pupil outcomes, instructional 
time, and means of instruction. From this contrast, we expected to be ( 
able to .answer three specific questions. 

1. What are the effects on reading instruction of using the WDRSD 
reading program in an IGE and a non~IGE school environjnent? • 

2. What are the effects on reading instruction of using WDRSD and 
using other reading programs in the IGE school environment? 

3. What are the relationships among the variables presented in 

the Phase IV model? (See Figure 2, page 13.) 6 

123- 149 I 
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General Findings 

Before we attempt to summarize the findings with* respect to the specific 
questioks above, an overall picture of reading instruction, both at (^rade 2, 



and Grade 5 in^^l^is sample of schools, is warranted. The data presented in 
the previous chapters in some sense describe 22 quite different instructional 
sett ings- (-ll-school~Sj two -grades- at each -school) , It appears that each of- the 
22 learning environments is unique. The demography^ of the school, the way in 
which it is organiz.ed, the degree of -implementation of various components of 
IGE, the way in which time is used in classrooms, the way in which instruction 
is actually carried but,', and the. level of achievement on different objectives 
present an interesting descriptive picture about each learning environment. 
However, there is little common from situation to situation. For example, 
using the background variables, we were able to form four clusters of 
schools — three pairs of schools and a triplet; there* were also tw& isolate 
cases. riowever, when wfe looked at how time, was actually allocated and spent 
on various objectives in reading and the way in which instruction was carried 
out, the clusters did not demonstrate a consistent pattern related to' 
instruction. Thus,, the first conclusion of the study is that there is • 

no obvious pattern by which the,dif f erent learning environments at each 

\ j ' . ' ■ ' 

grade level can be ai^ropriately grouped ;-rone cannot confidently argue that 

- 

any two classrooms (or unfits) operated in 'the same way. 

In spite of this first conclusion, some. general statements can be made 
about reading instruction. At second grade, although there is considerable 
variation in. amount of allocated time to different objectives, it is clear 
that all schooj-s emphasize work on word attack, skills since it comprises 
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the largest percentage of allocated^ time in 10 of the classrooms. Most 
of the remaining time is distributed somewhat unevenly over study skills 
and comp^"^b^-sion skills. However, at Grade 5, there is little consistent 
emphasis on any objectives. In fact, at both grades, while a lot of time 
is allocated to reading instruction, what is actually taught, time spent 
on specific objectives, differs' vastly in each class. This might be 
appropriate if the differing emphasis reflected the needs of students which 
in turn would be reflected -in- improved performance. Unfortunately, the data 
fail to support this conjecture. In all classes, a lot of time was allocated 
to specific skills with little apparent gain in performance. Part of the 
lack:of gain is due to the fact that achievement at time 1 on most objec- 
tives/was fairly high. Part is due to items for a general objective which 
were not necessarily related to all the subskills; time possibly was spent 
on untested subskills. However, a more persuasive conjecture seems to be 
that teachers chose to base reading instruction in their classes on what 
they customarily covered'' at each grade level rather than on individual 
needs, and what they customarily covered was idiosyncratic. 

Specific Findings 

Research Question 1 . What are the effects on reading instruction of 
using the WDRSD reading program in an IGE setting and a non-IGE school 
, setting? 

Whether a^ school calls itself IGE or not is not an important variable; 
the label difference is not a goo(J indicator of operating differences in 
the schools. The instructional programming model is the key here. It is 
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what good teachers f oil .fw anyway. This study is not a good test of use 
of the instructional prog ramming model. 

Research Question 2> What ara the effects on reading instruction of 
using WDRSD and using other reading programs in the IGE school environment? 

' At Grade 2, the aon -WDRSD users did not allocate much time to study 
skills. The differences on study skill performance between WDRSD and non- 
WDRSD groups favor the use of that component of WDRSD, Similar differences 
at Grade 5 were iict_ fouiK, - Thus, our second conclusion is that the dif- 
ferences between usciiV. cu^d non-users of WDRSD are not generally apparent. 

Research Question 3 . What are the relationships between the variables 
presented in the model for the evaluation? 

The overall relationship as proposed in the model cannot be statistically 
examined in the study. Many of the variables are highly correlated and the ' 
sample is very small. It wnr^ hoped that an overall pattern could be seen 
with respect to the variables; this is not the case. A lower limit 
on allocated time is needed to increase achievement ;Ln any area, but the 
relationship of allocated time to performance is not linear. For example, 
at Grade 2, the variability in allocated time to word attack skills is not 
related to achievement since all spend a lot of time. In fact, some schools, 
iixe probably spending too miich time for the relative pay off. 

Limitations A 

Before concluding this chapter, let us remind the reader of four basic 
Limitiations of this study. First , - these data com^ from a small sample of 
schools. No claim can be made that they are representative either of WDRSD 
users or of IGE schools. Second, the variables examined in this study are 
the variables of interest in the IGE model. The data associated with these 
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variables are highly correlated. For example, allocated time is highly 
correlated with engaged time. Analysis on small sets of related data could 
not be done with meaning and has not been attempted; the relationships 
discussed above must be- considered suspect. Third, there are four different 
sets of data on these classrooms.' The background data were provided by 
teachers and administrators vfrom self-report questionnaires. These data 
provide information about school-wide pat\:erns. The class log data were 
provided by teachers on how time was spent for one group of children in 
their classrooms; observations in those classrooms were often on different 
sets of students as regrouping took place. These two data sets provide 
different estimates of class variables. The achievement data came from 
all students, providing information about the total population. The 
appropriateness of the sources for predicting what the group is like 
has not been demonstrated. Finally, although our intent was to describe 
means of instruction related to reading skill development, all time spent 
on reading activities should have been coded in every school. 

Conclusions ♦ 

On reflection, it is now clear that selecting schools because they 
call themselves **IGE schools" or "WDRSD users" is m;:; -adequate for testing 
either the use. of the instructional programming model, the key feature of 



IGiZ, or the use of the particular instructional materials, Wisconsin 
Design for Reading Skill Development. For bothj a school's use of the 
label is no guarantee that the ideas associated with either the instructional 
programming model or WDRSD are being followed. '^Jn fact, what 'seems to be the 



case is that_the underlying conceptual ideas which guided the developers of 
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IGE or WDRSD are not clearly reflected in the way in which instruction is 
carried out. This conclusion may be an artifact of the sample chosen or 
it may be more pervasive. In fact, it may be unreasonable to expect people 
to change as much as v/as expected in an IGE/WDRSD setting. For example, 
the teacher using WDRSD materials without testing or small 
groups is hardly usj.ig the program. Or, an IGE school in which teachers 
do not regroup students periodically according to need does not provide 
a good test of the instructional programming model. 

It should be apparent that we have not reported all of the data 
gathered in this study. It would have been better to gather less data 
from more schools. What we have is an extensive description of 22 different 
learning environments, not one of which reflects in a clear way the ideas 
underlying IGE or WDRSD, In fact, the strongest claim that can be made 
is that each class has its ovm characteristics. This diversity is not a 
function of the type of community, of the way in which instruction is 
carried out, of whether a school calls itself IGE, or whether they use 
a particular reading program. 

What can be said in conclusion is that one needs to spend a minimum 
amount of time on an objective to produce achievement; and that time 
should be allocated to skills where there is a need, 

\ 
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